-- Logs begin at Thu 2022-09-01 16:47:58 UTC, end at Thu 2022-09-01 17:59:47 UTC. -- Sep 01 17:22:24.218796 dv-cinder-852211-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 17:22:24.228540 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 17:22:24 2022] *** Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: nodename: dv-cinder-852211-8-iscsi Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: machine: x86_64 Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: clock source: unix Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: pcre jit disabled Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: detected number of CPU cores: 4 Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: current working directory: / Sep 01 17:22:24.230541 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: detected binary path: /usr/bin/uwsgi-core Sep 01 17:22:24.231253 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: your processes number limit is 47680 Sep 01 17:22:24.231253 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: your memory page size is 4096 bytes Sep 01 17:22:24.231253 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: detected max file descriptor number: 2048 Sep 01 17:22:24.231253 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: lock engine: pthread robust mutexes Sep 01 17:22:24.231253 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: thunder lock: enabled Sep 01 17:22:24.231253 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 17:22:24.231253 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 17:22:24.270747 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: Python main interpreter initialized at 0x56251001b9c0 Sep 01 17:22:24.270747 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: python threads support enabled Sep 01 17:22:24.270747 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: your server socket listen backlog is limited to 100 connections Sep 01 17:22:24.270747 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: your mercy for graceful operations on workers is 90 seconds Sep 01 17:22:24.271146 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 17:22:24.271146 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: *** Operational MODE: preforking *** Sep 01 17:22:24.271407 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: *** uWSGI is running in multiple interpreter mode *** Sep 01 17:22:24.271407 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: spawned uWSGI master process (pid: 105478) Sep 01 17:22:24.271609 dv-cinder-852211-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 17:22:24.272610 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: spawned uWSGI worker 1 (pid: 105479, cores: 1) Sep 01 17:22:24.272610 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: spawned uWSGI worker 2 (pid: 105480, cores: 1) Sep 01 17:22:24.272919 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 17:22:24.930727 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:22:24.931340 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:22:26.017966 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:22:26.017966 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: from cryptography.utils import int_from_bytes Sep 01 17:22:26.018581 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:22:26.018581 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: from cryptography.utils import int_from_bytes Sep 01 17:22:26.018581 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:22:26.018581 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: from cryptography.utils import int_from_bytes Sep 01 17:22:26.019060 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:22:26.019060 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: from cryptography.utils import int_from_bytes Sep 01 17:22:28.520966 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:22:28.521679 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:22:28.521777 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:22:28.521777 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:22:28.522175 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:22:28.522252 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:22:28.522319 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:22:28.522395 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:22:28.522461 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:22:28.522672 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:22:28.522771 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.523032 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.523118 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.523354 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.523450 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.523670 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.523765 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.523988 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.524087 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.524296 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.524387 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.524608 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.524709 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.524921 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.525009 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.525243 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.525415 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.525536 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.525629 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.525833 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.525923 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.526143 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.526237 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-8-iscsi {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.526463 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-8-iscsi {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.526560 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.526766 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.526852 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.527067 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.527153 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.527373 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.527472 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.527671 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.527758 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.527972 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.528062 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.528286 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.528396 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.528587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.528779 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.529077 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.529220 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.529412 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.529550 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.529718 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.529852 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.530023 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.530193 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.530354 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.530509 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.530666 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.530816 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.530972 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.531135 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.531285 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.531444 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.531589 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.531766 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.531907 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.532074 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.532212 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.532493 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-8-iscsi {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.532742 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-8-iscsi {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.532829 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.533056 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.533152 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.533387 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.533496 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.533696 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.533825 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.534104 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.534250 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.534413 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.534567 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.534720 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.534807 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.535036 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.535138 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.535340 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.535427 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.535657 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.535742 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.535973 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.536110 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.536285 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.536373 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.536604 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.536718 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.536895 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.536991 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.537201 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.537295 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.537536 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.537624 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.537853 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.537945 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.538154 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.538243 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.538455 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.538549 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.538709 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.538829 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.539020 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.539120 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.539324 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.539502 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.539647 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.539743 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.539951 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.540044 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.540195 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.540306 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.540426 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.540542 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.540738 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.540830 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.541051 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.541152 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.541438 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.541534 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.541686 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.541787 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.541988 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.542088 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.542290 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.542382 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.542594 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.542695 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.542895 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.542999 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.543198 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.543288 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.543496 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.543596 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.543797 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.543889 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.544108 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.544199 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.544416 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.544516 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.544727 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.544819 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.545028 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.545126 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.545362 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.545485 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.545693 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.545787 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.545985 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.546083 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.546285 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.546399 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.546616 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.546710 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.546918 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.547008 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.547219 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.547308 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.547529 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.547621 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.547832 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.547923 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.550244 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.552359 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.552506 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.552657 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.552794 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.552951 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.553090 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.553227 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.553418 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.553569 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.553569 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.553930 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.553930 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.554203 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.554340 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.554476 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.554623 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.554769 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.554907 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.555052 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.555190 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.555325 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.555471 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.555625 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.555782 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.556001 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.556147 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.556291 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.556437 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.556594 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.556733 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.556869 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.557005 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.557142 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.557287 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.557462 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.557599 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.557735 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.557871 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.558006 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.558162 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.558301 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.558467 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.558612 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.558754 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.558890 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.559035 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.559179 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.559330 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.559469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.559613 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.559750 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.559895 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.560039 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.560206 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.560459 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.560611 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.560750 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.560895 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.561039 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.561183 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.561362 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.561508 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.561645 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.561794 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.561932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.562068 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.562215 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.562353 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.562489 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.562635 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.562773 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.562916 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.563054 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.563198 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.563336 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.563483 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.563621 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.564267 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.564404 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.564561 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.564707 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.564853 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.564990 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.565126 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.565262 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.565438 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.565587 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.565732 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.565869 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.566031 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.566241 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.566384 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.566547 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.566687 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.566831 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.566976 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.567113 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.567250 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.567395 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.567534 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.567671 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.567848 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.568006 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.568155 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.568317 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.568463 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.568620 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.568771 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.568910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.569065 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.569212 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.569397 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.569544 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.569683 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:22:28.569820 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.570039 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.570179 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.570338 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.570477 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.570613 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.570751 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.570907 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.571053 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.571193 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.571331 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.571467 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.571613 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.571751 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.571895 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.572050 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.572195 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.572339 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.572487 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.572660 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.572884 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.573107 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.573374 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.573611 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.573849 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.574072 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.574289 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.574538 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.574801 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.575034 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.575267 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.575489 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.575489 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.575899 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.575899 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.576455 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.576455 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.576896 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.577116 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.577406 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.577629 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.577863 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.578101 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.578335 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.578553 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.578781 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.579006 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.579241 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.580120 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.580345 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.580562 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.580778 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.581016 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.581261 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.581506 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.581738 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.581967 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.582201 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.582430 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.582693 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.582902 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.583111 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.583328 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.583558 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.583773 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.583940 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.584092 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.584238 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.584377 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.584525 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.584941 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.585173 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.585388 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.585535 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.585673 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.585820 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.586008 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.586152 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.586290 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.586539 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.586685 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.586821 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.586967 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.587106 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.587242 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.587379 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.587517 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.587653 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.587799 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.587937 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.588082 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.588220 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.588367 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.588520 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.588661 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.588797 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.588942 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.589087 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.589229 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.589408 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.589550 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.589696 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.589834 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.589971 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.590106 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.590263 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.590409 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.590547 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.590693 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.590832 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.590969 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.590969 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.591242 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.591242 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.591509 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.591646 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.591801 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.591801 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.592082 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.592082 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.592599 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.592599 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.592868 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.593016 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.593162 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.593300 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.593495 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.593634 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.593780 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.593919 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.594067 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.594211 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.594349 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.594493 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.594643 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.594782 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.594938 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.595082 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.595218 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.595356 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.595501 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.595640 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.595783 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.595944 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.596093 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.596311 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.596452 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.596676 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.596821 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.596960 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.597097 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.597250 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.597416 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.597569 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.597707 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.597844 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.597997 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.598145 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.598284 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.598436 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.598575 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.598720 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.598867 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.599006 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.599155 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.599302 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.599446 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.599591 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.599752 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.599898 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.600035 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.600172 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.600308 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.600444 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.600589 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.600727 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.600863 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.601007 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.601145 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.601288 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.601490 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.601648 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.601792 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.601943 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.602087 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.602230 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.602386 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.602531 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.602674 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.602823 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.602968 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.603128 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.603274 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.603417 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.603585 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.603730 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.603874 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.604026 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.604171 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.604316 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.604458 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.604601 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.604743 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.604895 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.605040 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.605183 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.605351 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.605513 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.605657 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.605813 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.605958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.606102 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.606244 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.606395 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.606552 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.606713 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.606928 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.607078 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.607221 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.607382 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.607536 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.607681 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.607824 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.607980 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.608125 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.608268 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.608420 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.608566 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.608716 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.608862 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.609004 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.609158 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.609377 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.609543 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.609689 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.609832 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.609975 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.610127 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.610279 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.610423 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.610578 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.610727 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.610870 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.611023 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.611167 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.611328 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.611472 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.611616 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.611759 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.611911 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.612063 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.612207 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.612350 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.612493 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.612643 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.612800 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.612944 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.613087 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.613240 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.613412 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.613412 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.613729 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.613880 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.614023 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.614164 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.614306 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.614458 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.614616 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.614762 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.614912 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.615057 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.615210 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.615362 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.615507 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.615649 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.615799 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.615944 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.616088 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.616240 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.616385 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.616527 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.616676 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.616828 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.617065 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.617239 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.617448 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.617595 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.617739 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.617883 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.618044 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.618191 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.618343 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.618488 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.618630 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.618774 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.618926 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.619098 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.619247 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.619398 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.619543 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.619686 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.619843 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.619988 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.620132 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.620282 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.620434 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.620578 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.620731 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.620875 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.621029 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.621174 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.621340 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.621502 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.621648 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.621791 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.621957 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.622103 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.622245 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.622396 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.622541 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.622691 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.622847 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.623002 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.623147 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.623299 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.623450 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.623595 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.623738 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.623880 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.624022 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.624237 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.624384 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.624527 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.624670 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.624813 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.624976 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.625121 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.625267 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.625445 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.625591 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.625733 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.625889 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.626034 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.626683 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.626836 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.626987 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.627215 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.627377 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.627533 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.627684 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.627842 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.627994 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.628138 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.628289 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.628442 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.628587 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.628730 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.628873 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.629029 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.629182 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.629391 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.629553 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.629698 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.629841 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.629992 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.630137 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.630280 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.630431 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.630576 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.630718 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.630869 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.631022 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.631166 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.631327 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.631471 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.631615 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.631770 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.631914 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.632056 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.632199 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.632350 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.632494 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.632647 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.632792 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.632935 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.633085 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.633239 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.633422 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.633569 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.633712 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.633855 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.633998 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.634147 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.634308 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.634460 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.634603 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.634603 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.634876 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.635030 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.635182 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.635182 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.635455 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.635604 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.635749 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.635905 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.636060 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.636225 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.636379 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.636531 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.636676 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.636839 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.637003 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.637156 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.637449 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.637610 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.637755 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.637899 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.637899 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.638170 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.638328 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.638482 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.638635 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.638781 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.638925 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.639086 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.639245 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.639391 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.639535 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.639679 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.639822 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.639975 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.640128 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.640282 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.640428 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.640571 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.640714 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.640867 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.641023 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.641167 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.641334 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.641496 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.641650 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.641806 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.642532 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.642686 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.642840 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.642986 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.643130 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.643287 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.643445 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.643589 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.643732 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.643875 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.644028 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.644174 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.644317 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.644460 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.644603 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.644747 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.644899 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.645051 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.645197 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.645410 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.645563 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.645706 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.645862 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.646016 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.646161 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.646305 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.646449 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.646604 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.646750 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.646894 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.647038 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.647182 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.647182 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.647572 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.647726 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.647870 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.648025 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.648179 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.648330 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.648555 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.648710 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.648863 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.649015 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.649178 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.649361 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.649530 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.649676 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.649819 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.649968 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.650113 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.650265 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.650410 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.650553 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.650695 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.650695 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.650974 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.650974 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.651268 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.651412 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.651556 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.651698 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.651841 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.651841 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.652128 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.652280 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.652425 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.652569 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.652711 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.652869 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.653014 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.653168 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.653335 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.653488 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.653644 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.653790 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.653933 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.654076 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.654218 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.654361 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.654516 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.654669 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.654814 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.654957 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.655121 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.655266 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.655426 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.655579 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.655724 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.655874 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.656026 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.656170 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.656332 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.656478 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.656620 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.656764 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.656907 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.657070 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.657216 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.657381 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.657576 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.657806 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.657958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.658115 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.658260 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.658412 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.658558 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.658714 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.658860 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.659027 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.659184 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.659329 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.659473 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.659617 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.659760 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.659913 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.660065 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.660218 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.660370 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.660514 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.660665 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.660817 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.660980 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.661126 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.661270 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.661457 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.661623 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.661777 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.661921 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.662066 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.662209 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.662352 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.662505 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.662650 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.662793 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.662954 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.663107 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.663253 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.663406 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.663561 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.663706 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.663850 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.663994 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.664147 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.664291 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.664436 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.664581 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.664726 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.664879 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.665032 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.665186 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.665371 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.665522 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.665679 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.665823 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.665975 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.666120 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.666271 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.666422 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.666567 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.666719 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.666884 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.667029 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.667178 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.667329 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.667474 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.667618 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.667788 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.668005 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.668156 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.668301 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.668445 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.668597 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.668760 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.668906 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.669063 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.669212 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.669402 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.669566 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.669712 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.669855 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.669999 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.670142 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.670286 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.670439 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.670592 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.670747 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.670891 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.671034 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.671185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.671338 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.671484 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.671627 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.671779 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.671923 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.672080 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.672226 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.672370 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.672513 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.672674 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.672819 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.672972 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.673153 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.673339 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.673494 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.673638 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.673791 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.673946 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.674091 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.674242 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.674393 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.674546 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.674705 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.674859 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.675004 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.675147 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.675297 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.675442 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.675594 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.675740 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.675891 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.676036 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.676179 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.676321 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.676550 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.676706 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.676851 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.676995 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.677138 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.677290 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.677525 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.677680 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.677824 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.677967 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.678207 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.678366 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.678521 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.678689 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.678835 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.678992 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.679142 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.679295 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.679440 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.679585 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.679727 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.679871 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.680014 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.680166 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.680310 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.680454 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.680607 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.680758 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.680903 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.681056 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.681201 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.681378 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.681378 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.681658 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.681658 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.681940 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.682085 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.682228 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.682370 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.682530 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.682530 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.682813 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.682958 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.683100 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.683242 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.683385 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.683385 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.683667 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.683810 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.683953 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.684096 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.684262 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.684415 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.684560 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.684703 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.684853 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.684998 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.685143 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.685299 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.685499 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.685643 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.685787 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.685787 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.686139 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.686139 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.686441 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.686659 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.686815 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.686815 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.687087 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.687231 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.687383 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.687528 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.687682 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.687828 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.687970 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.688113 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.688363 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.688516 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.689188 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.689366 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.689535 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.689682 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.689836 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.689981 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.690134 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.690279 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.690431 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.690576 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.690740 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.690740 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.691025 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.691169 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.691314 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.691466 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.691611 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.691754 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.691897 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.691897 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.692168 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.692321 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.692466 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.692621 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.692765 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.692909 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.693053 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.693205 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.693382 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.693535 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.693679 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.693821 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.693975 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.694130 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.694286 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.694430 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.694593 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.694738 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.694890 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.695042 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.695186 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.695329 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.695472 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.695617 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.695769 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.695914 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.696058 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.696201 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.696351 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.696506 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.696663 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.696809 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.696952 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.697095 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.697239 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.697426 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.697584 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.697731 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.697881 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.698027 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.698170 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.698349 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.698574 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.698726 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.698870 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.699014 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.699158 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.699310 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.699462 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.699610 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.699754 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.699896 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.700040 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.700201 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.700359 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.700503 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.700647 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.700798 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.700943 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.701095 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.701239 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.701434 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.701536 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.701624 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.701725 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.701813 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.701895 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.701976 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702055 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702135 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702224 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702308 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702387 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702467 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702546 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702624 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702712 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702793 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702872 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.702951 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703029 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703107 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703194 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703275 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703354 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703432 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703528 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703619 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703689 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703764 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703832 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703897 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.703963 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.704038 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.704106 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.704172 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.704238 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.704303 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.704449 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705057 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705129 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705195 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705260 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705351 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705422 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705503 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705572 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705638 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705702 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705767 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705845 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705913 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.705985 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706053 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706128 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706196 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706269 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706342 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706431 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706505 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706587 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706672 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706773 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706856 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.706934 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707014 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707099 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707188 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707281 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707362 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707362 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707504 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707582 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707668 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707749 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707827 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707827 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.707978 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708056 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708148 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708240 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708320 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708398 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708483 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708563 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708639 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708706 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708771 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708771 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708912 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.708990 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709150 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709233 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709369 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709475 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709559 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709662 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709744 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709823 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709902 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.709979 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710058 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710148 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710236 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710236 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710379 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710466 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710560 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710641 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710719 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710719 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710859 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.710938 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711023 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711023 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711168 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711168 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711314 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711400 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711492 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711572 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711649 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711727 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711804 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711893 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.711973 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712062 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712148 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712227 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712309 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712397 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712477 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712563 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712649 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712729 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712814 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712894 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.712972 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.713190 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.713338 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.713524 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.713643 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.713845 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.713934 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.714177 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.714274 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.714488 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.714585 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.714794 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.714881 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.715103 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.715241 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.715414 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.715501 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.715746 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.715929 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.716071 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.716244 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.716385 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.716572 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.716697 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.716893 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.717012 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.717496 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.717810 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.717897 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.718122 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.718208 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.718444 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.718543 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.718744 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.718837 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.719046 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.719139 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.719353 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.719492 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.719657 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.719743 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.719981 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.720077 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.720300 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.720400 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.720601 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.720694 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.720899 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.720984 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.721205 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.721332 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.721531 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.721617 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.721853 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.722062 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.722165 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.722404 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.722503 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.722717 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.722804 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.723037 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.723131 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.723343 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.723569 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.723668 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.723917 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.724005 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.724232 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.724327 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.724531 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.724617 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.724832 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.724925 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.725141 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.725228 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.725477 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.725567 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.725776 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.725874 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.726076 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.726171 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.726381 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.726468 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.726687 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.726783 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.726986 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.727073 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.727286 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.727371 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.727581 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.727682 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.727888 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.727980 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.728187 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.728272 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.728485 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.728579 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.728781 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.728917 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.729081 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.729166 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.729399 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.729532 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.729700 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.729787 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.729999 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.730084 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.730296 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.730384 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.730599 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.730685 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.730896 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.730988 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.731196 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.731283 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.731491 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.731575 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.731791 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.731876 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.732086 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.732172 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.732388 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.732473 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.732696 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.732781 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.732999 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.733087 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.733396 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.733509 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.733630 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.733725 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.733940 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.734030 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.734247 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.734341 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.734562 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.734727 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.734868 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.734955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.735165 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.735264 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.735478 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.735573 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.735815 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.735901 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.736141 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.736341 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.736453 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.736671 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.736759 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.736988 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.737096 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.737329 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.737437 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.737665 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.737955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.738043 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.738261 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.738354 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.738563 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.738651 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.738883 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.739019 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.739244 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.739342 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.739572 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.739662 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.739862 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.739950 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.740173 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.740268 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.740497 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.740583 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.740807 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.740893 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.741112 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.741211 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.741442 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.741534 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.741753 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.741839 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.742057 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.742161 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.742362 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.742448 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.742667 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.742755 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.742970 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.743058 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.743274 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.743359 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.743583 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.743681 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.743889 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.743985 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.744196 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.744283 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.744505 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.744592 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.744816 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.744911 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.745124 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.745210 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.745458 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.745588 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.745764 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.745854 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.746067 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.746153 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.746370 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.746476 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.746679 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.746770 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.747002 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.747096 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.747311 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.747455 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.747618 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.747765 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.747925 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.748191 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.748294 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.748483 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.748571 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.748799 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.748885 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.749116 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.749210 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.749446 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.749577 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.749765 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.749890 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.750084 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.750209 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.750390 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.750528 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.750706 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.750839 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.751011 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.751679 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.751867 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.752014 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.752208 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.752325 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.752532 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.752645 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.752851 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.752937 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.753151 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.753268 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.753479 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.753626 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.753788 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.753944 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.754095 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.754275 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.754402 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.754584 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.754711 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.754892 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.755012 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.755196 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.755298 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.755534 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.755624 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.755830 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.755919 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.756139 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.756232 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.756447 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.756540 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.756745 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.756838 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.757048 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.757141 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.757362 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.757467 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.757666 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.757759 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.757966 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.758058 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.758260 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.758351 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.758558 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.758665 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.758860 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.758947 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.759199 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.759294 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.759454 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.759552 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.759753 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.759840 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.760048 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.760160 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.760342 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.760494 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.760637 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.760733 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.760938 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.761032 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.761242 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.761405 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.761600 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.761690 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.761908 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.761995 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.762211 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.762306 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.762542 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.762629 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.762858 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.762956 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.763176 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.763263 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.763489 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.763581 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.763796 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.763966 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.764131 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.764213 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.764411 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.764497 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.764715 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.764807 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.765023 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.765111 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.765346 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.765437 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.765662 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.765773 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.765983 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.766072 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.766275 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.766364 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.766596 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.766712 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.767454 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.767557 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.767765 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.767865 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.768075 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.768189 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.768383 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.768489 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.768698 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.768794 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.769010 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.769109 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.769335 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.769436 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.769658 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.769758 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.769961 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.770059 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.770268 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.770365 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.770571 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.770667 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.770878 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.771019 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.771181 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.771286 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.771489 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.771596 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.771793 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.771903 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.772099 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.772195 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.772407 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.772511 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.772716 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.772814 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.773038 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.773136 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.773367 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.773479 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.773676 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.773889 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.773993 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.774073 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.774292 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.774396 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.774618 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.774715 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.774928 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.775028 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.775239 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.775335 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.775566 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.775664 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.775874 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.775977 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.776183 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.776281 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.776484 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.776581 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.776719 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:22:28.776853 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.777176 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.777516 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.777831 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.778136 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:22:28.778382 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:22:28.930996 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Registered counter for database nova_api Sep 01 17:22:28.932071 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO dbcounter [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Registered counter for database nova_api Sep 01 17:22:28.952200 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_db.sqlalchemy.engines [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:22:28.955372 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:22:28.959053 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writer thread running {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:22:28.962378 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:22:29.017315 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.context [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bde3a620-b7c5-42e8-8ce6-210f3b120a6d(cell1) {{(pid=105480) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:22:29.020855 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.context [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bde3a620-b7c5-42e8-8ce6-210f3b120a6d(cell1) {{(pid=105479) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:22:29.021261 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:22:29.021716 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:22:29.023281 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:22:29.024008 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:22:29.024452 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:22:29.024739 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:22:29.025207 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:22:29.026479 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:22:29.026802 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:22:29.027534 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:22:29.027983 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:22:29.028451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO dbcounter [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Registered counter for database nova_cell0 Sep 01 17:22:29.030228 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_concurrency.lockutils [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:22:29.032236 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Registered counter for database nova_cell0 Sep 01 17:22:29.032495 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO dbcounter [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Registered counter for database nova_cell1 Sep 01 17:22:29.036282 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Registered counter for database nova_cell1 Sep 01 17:22:29.039941 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_db.sqlalchemy.engines [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:22:29.041716 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_db.sqlalchemy.engines [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:22:29.043570 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:22:29.047138 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:22:29.047272 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writer thread running {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:22:29.050279 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:22:29.189236 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writer thread running {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:22:29.191170 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:22:29.198464 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO dbcounter [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Registered counter for database nova_cell0 Sep 01 17:22:29.200265 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO dbcounter [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Registered counter for database nova_cell0 Sep 01 17:22:29.205959 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_db.sqlalchemy.engines [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:22:29.209701 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:22:29.210818 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writer thread running {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:22:29.214432 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writer thread running {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:22:29.547517 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:22:29.550113 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: WARNING keystonemiddleware.auth_token [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:22:29.555409 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:22:29.557482 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: WARNING keystonemiddleware.auth_token [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:22:29.897669 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:22:29.899516 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: WARNING keystonemiddleware.auth_token [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:22:29.903638 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: WARNING keystonemiddleware.auth_token [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:22:29.905531 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: WARNING keystonemiddleware.auth_token [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:22:29.908904 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56251001b9c0 pid: 105479 (default app) Sep 01 17:22:29.910790 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56251001b9c0 pid: 105480 (default app) Sep 01 17:22:29.910998 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:22:29.912201 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-3c2132fc-13f7-441e-8c74-1b4562442a83 None None] 10.222.0.102 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001750 Sep 01 17:22:29.912617 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 1/1] 10.222.0.102 () {50 vars in 793 bytes} [Thu Sep 1 17:22:29 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:23:48.988001 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:23:48.989355 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002123 Sep 01 17:23:48.989868 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 1/2] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:23:48 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:23:49.002058 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=3 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:23:49.003180 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell0:SELECT=3 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:23:49.004428 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell1:SELECT=3 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:23:49.005254 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:23:49.881072 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-405e1870-04f0-4b1a-8d1c-c98c809b069b admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:23:49.916227 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-405e1870-04f0-4b1a-8d1c-c98c809b069b admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919816 Sep 01 17:23:49.917082 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 2/3] 10.222.0.102 () {60 vars in 1297 bytes} [Thu Sep 1 17:23:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:23:52.350359 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:23:52.351467 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-360ff6ff-e12f-45a3-ae4c-fe7e229a95ad None None] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001473 Sep 01 17:23:52.364758 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 2/4] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:23:52 2022] GET /compute/v2.1 => generated 389 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:23:52.832963 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-2c9a362c-4b2d-48b1-83aa-385d4349e5fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:23:52.893015 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-2c9a362c-4b2d-48b1-83aa-385d4349e5fa admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.534187 Sep 01 17:23:52.893734 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 3/5] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:23:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:23:53.116817 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-b1e95360-cd0f-4d53-8246-25df4976a6cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:23:53.123389 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=3 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:23:53.124192 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell0:SELECT=3 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:23:53.125104 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell1:SELECT=3 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:23:53.125818 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:23:53.186084 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-b1e95360-cd0f-4d53-8246-25df4976a6cf admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283651 Sep 01 17:23:53.186699 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 3/6] 10.222.0.102 () {64 vars in 1341 bytes} [Thu Sep 1 17:23:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:23:55.567770 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-2c9a362c-4b2d-48b1-83aa-385d4349e5fa admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:23:55.568603 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-2c9a362c-4b2d-48b1-83aa-385d4349e5fa admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001477 Sep 01 17:23:55.569199 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 4/7] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:23:55 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:23:56.244424 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-440dfc67-d525-4cca-8750-f345ad1d34f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:23:56.288703 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-440dfc67-d525-4cca-8750-f345ad1d34f5 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.711728 Sep 01 17:23:56.291767 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 4/8] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:23:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:23:56.303832 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-a75058ea-6d50-4a89-bd87-b9324be44476 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:23:56.344366 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-a75058ea-6d50-4a89-bd87-b9324be44476 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044647 Sep 01 17:23:56.345782 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 5/9] 10.222.0.102 () {64 vars in 1341 bytes} [Thu Sep 1 17:23:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:23:58.749758 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-440dfc67-d525-4cca-8750-f345ad1d34f5 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:23:58.750707 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-440dfc67-d525-4cca-8750-f345ad1d34f5 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001523 Sep 01 17:23:58.751112 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 5/10] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:23:58 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:23:59.164750 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-ec1b4078-d292-4bcd-aa89-827ecd8b23b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:23:59.184040 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-ec1b4078-d292-4bcd-aa89-827ecd8b23b2 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.426627 Sep 01 17:23:59.184592 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 6/11] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:23:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:23:59.196888 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-d079a6c7-5ca0-4f4b-a331-07a8515bedd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:23:59.220988 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-d079a6c7-5ca0-4f4b-a331-07a8515bedd1 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027899 Sep 01 17:23:59.221892 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 6/12] 10.222.0.102 () {64 vars in 1341 bytes} [Thu Sep 1 17:23:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:24:01.620554 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-ec1b4078-d292-4bcd-aa89-827ecd8b23b2 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:01.621593 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-ec1b4078-d292-4bcd-aa89-827ecd8b23b2 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001468 Sep 01 17:24:01.621993 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 7/13] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:24:01 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:02.145684 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-44ccaae4-ddb2-4678-a28c-f32c545074e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "ram": 2048}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:02.170250 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-44ccaae4-ddb2-4678-a28c-f32c545074e7 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.542281 Sep 01 17:24:02.170796 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 7/14] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:24:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:24:02.183268 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-f464d633-28c2-4941-8210-e6b04b684844 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:02.208134 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-f464d633-28c2-4941-8210-e6b04b684844 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029038 Sep 01 17:24:02.208793 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 8/15] 10.222.0.102 () {64 vars in 1341 bytes} [Thu Sep 1 17:24:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:24:04.593973 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-44ccaae4-ddb2-4678-a28c-f32c545074e7 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:04.595715 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-44ccaae4-ddb2-4678-a28c-f32c545074e7 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002212 Sep 01 17:24:04.596602 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 8/16] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:24:04 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:05.198049 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-e6b67970-c767-43f6-97f0-a9d8510a7cb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:05.226087 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-e6b67970-c767-43f6-97f0-a9d8510a7cb2 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.622141 Sep 01 17:24:05.226966 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 9/17] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:24:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:24:05.239251 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-38bca865-dc87-4c1d-903f-5564da171bd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:05.265862 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-38bca865-dc87-4c1d-903f-5564da171bd3 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030288 Sep 01 17:24:05.266588 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 9/18] 10.222.0.102 () {64 vars in 1341 bytes} [Thu Sep 1 17:24:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:24:07.651895 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-e6b67970-c767-43f6-97f0-a9d8510a7cb2 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:07.652963 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-e6b67970-c767-43f6-97f0-a9d8510a7cb2 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001578 Sep 01 17:24:07.653409 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 10/19] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:24:07 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:08.117672 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-fccca979-1345-4a4e-afbd-ddbfe60d2b7a admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:08.143298 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-fccca979-1345-4a4e-afbd-ddbfe60d2b7a admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.483402 Sep 01 17:24:08.143845 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 10/20] 10.222.0.102 () {60 vars in 1297 bytes} [Thu Sep 1 17:24:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:24:10.748207 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-e6b67970-c767-43f6-97f0-a9d8510a7cb2 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:10.749822 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-e6b67970-c767-43f6-97f0-a9d8510a7cb2 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002167 Sep 01 17:24:10.750885 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 11/21] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:24:10 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:11.278319 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-e2fb6c72-db33-4f62-b4f3-7034f3c9ec11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:11.299920 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-e2fb6c72-db33-4f62-b4f3-7034f3c9ec11 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541337 Sep 01 17:24:11.300506 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 11/22] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:24:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:24:11.315391 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-d5da80da-4bd2-4b92-8603-4932c581be75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:11.342267 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-d5da80da-4bd2-4b92-8603-4932c581be75 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030832 Sep 01 17:24:11.342868 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 12/23] 10.222.0.102 () {64 vars in 1338 bytes} [Thu Sep 1 17:24:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:24:13.717145 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-e2fb6c72-db33-4f62-b4f3-7034f3c9ec11 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:13.718347 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-e2fb6c72-db33-4f62-b4f3-7034f3c9ec11 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001606 Sep 01 17:24:13.718759 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 12/24] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:24:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:14.136700 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-a4d19f03-2a0c-478e-8b82-cd67b29b0b85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "2", "name": "m1.small"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:14.156325 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-a4d19f03-2a0c-478e-8b82-cd67b29b0b85 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.431355 Sep 01 17:24:14.156968 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 13/25] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:24:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:24:14.168905 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-944e5ad7-9e49-47c7-b0f0-5d2623cd6f1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:14.195074 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-944e5ad7-9e49-47c7-b0f0-5d2623cd6f1b admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029811 Sep 01 17:24:14.195773 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 13/26] 10.222.0.102 () {64 vars in 1338 bytes} [Thu Sep 1 17:24:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:24:16.622413 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-a4d19f03-2a0c-478e-8b82-cd67b29b0b85 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:16.623352 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-a4d19f03-2a0c-478e-8b82-cd67b29b0b85 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001471 Sep 01 17:24:16.623760 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 14/27] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:24:16 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:17.033512 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-48ad2b8f-16d2-4241-8a78-c0d4f3871873 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:17.060286 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-48ad2b8f-16d2-4241-8a78-c0d4f3871873 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.429889 Sep 01 17:24:17.061562 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 14/28] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:24:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:24:17.073872 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-3111cf07-4dbd-4195-b28b-6230a2c82a13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:17.101270 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-3111cf07-4dbd-4195-b28b-6230a2c82a13 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031285 Sep 01 17:24:17.102079 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 15/29] 10.222.0.102 () {64 vars in 1338 bytes} [Thu Sep 1 17:24:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:24:19.513354 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-48ad2b8f-16d2-4241-8a78-c0d4f3871873 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:19.514296 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-48ad2b8f-16d2-4241-8a78-c0d4f3871873 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001499 Sep 01 17:24:19.514948 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 15/30] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:24:19 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:20.004817 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-e6f6a79a-8677-4ad4-855e-e1a55cc1db57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "name": "m1.large", "id": "4", "ram": 8192}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:20.013571 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:24:20.025973 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-e6f6a79a-8677-4ad4-855e-e1a55cc1db57 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504618 Sep 01 17:24:20.026525 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 16/31] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:24:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:24:20.038818 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-a2b38aca-de23-4fbf-8fca-0bb97b0d6f53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:20.064676 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-a2b38aca-de23-4fbf-8fca-0bb97b0d6f53 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029826 Sep 01 17:24:20.065248 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 16/32] 10.222.0.102 () {64 vars in 1338 bytes} [Thu Sep 1 17:24:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:24:22.527984 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-e6f6a79a-8677-4ad4-855e-e1a55cc1db57 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:22.529728 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-e6f6a79a-8677-4ad4-855e-e1a55cc1db57 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002177 Sep 01 17:24:22.530207 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 17/33] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:24:22 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:23.048229 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-44e4009b-2d23-4a04-b0e9-3c6e1bc07d41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:23.070338 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-44e4009b-2d23-4a04-b0e9-3c6e1bc07d41 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.533637 Sep 01 17:24:23.071229 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 17/34] 10.222.0.102 () {64 vars in 1288 bytes} [Thu Sep 1 17:24:22 2022] POST /compute/v2.1/flavors => generated 410 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:24:23.089234 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-ebd16c12-4e4c-449b-bdcc-91b09c06ab22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:23.139893 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-ebd16c12-4e4c-449b-bdcc-91b09c06ab22 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057546 Sep 01 17:24:23.145481 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 18/35] 10.222.0.102 () {64 vars in 1338 bytes} [Thu Sep 1 17:24:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:24:41.930921 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-44e4009b-2d23-4a04-b0e9-3c6e1bc07d41 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:41.931971 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-44e4009b-2d23-4a04-b0e9-3c6e1bc07d41 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001514 Sep 01 17:24:41.932375 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 18/36] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:24:41 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:41.942982 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:24:42.356310 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-5c1fef5b-a730-4fbe-913f-1e5772943454 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:42.375547 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-5c1fef5b-a730-4fbe-913f-1e5772943454 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.436965 Sep 01 17:24:42.376015 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 19/37] 10.222.0.102 () {60 vars in 1297 bytes} [Thu Sep 1 17:24:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:24:43.432378 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-44e4009b-2d23-4a04-b0e9-3c6e1bc07d41 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:43.433433 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-44e4009b-2d23-4a04-b0e9-3c6e1bc07d41 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001448 Sep 01 17:24:43.433854 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 19/38] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:24:43 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:43.964714 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-96d8bf1d-7213-4158-8de1-94553903084c admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:43.970384 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.wsgi [None req-96d8bf1d-7213-4158-8de1-94553903084c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-96d8bf1d-7213-4158-8de1-94553903084c admin admin] Request method failure captured: Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Accept: application/json Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Accept-Encoding: gzip, deflate Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Connection: keep-alive Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Content-Length: 0 Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Host: 10.222.0.102 Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Openstack-Api-Version: compute 2.90 Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Openstack-System-Scope: None Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: User-Agent: python-novaclient Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Auth-Token: gAAAAABjEOrbATO4Z4QS-lyIJZCnqET22ajujdGSkaE374FeCJ-w2HfyFZckf6MuJ0Ab5NIVYH8642dCLUjUjISmpYhxLdkxragFSgXlTSTVnTbBKJ8Bt60NwGh2rogNTWgkcO7vKZdkTSAxrst701Vgmu1QTdZxD4Aw9yfbWWYi-0m4lqIL-YI Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Domain-Id: None Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Domain-Name: None Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Identity-Status: Confirmed Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Is-Admin-Project: True Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Domain-Id: default Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Domain-Name: Default Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Name: admin Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Role: reader,member,admin Sep 01 17:24:43.973707 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Roles: reader,member,admin Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ace9b3845813477eb192c158600d0beb", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ace9b3845813477eb192c158600d0beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}] Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Tenant: admin Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Tenant-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Tenant-Name: admin Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User: admin Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Domain-Id: default Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Domain-Name: Default Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Id: e6c9197e0f844432a03b9e75fc87712b Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Name: admin Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: method: > Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: exception: Flavor 42 could not be found. Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: action_args: {'id': '42'} Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:24:43.975389 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:43.976294 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:43.977587 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-96d8bf1d-7213-4158-8de1-94553903084c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:24:43.978825 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-96d8bf1d-7213-4158-8de1-94553903084c admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.404033 Sep 01 17:24:43.978825 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 20/39] 10.222.0.102 () {60 vars in 1195 bytes} [Thu Sep 1 17:24:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:43.984918 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-e45d89e8-0500-430b-bef3-b3aed89a0837 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:43.989040 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:24:44.008685 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-e45d89e8-0500-430b-bef3-b3aed89a0837 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027206 Sep 01 17:24:44.009238 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 20/40] 10.222.0.102 () {60 vars in 1215 bytes} [Thu Sep 1 17:24:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:24:44.019040 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-2575a057-b07b-4e62-a719-255a0ddd154e admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:44.041999 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-2575a057-b07b-4e62-a719-255a0ddd154e admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.026523 Sep 01 17:24:44.042557 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 21/41] 10.222.0.102 () {60 vars in 1215 bytes} [Thu Sep 1 17:24:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:24:44.052490 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-95fa1005-a2cf-4cd0-a7c5-3fa755d07220 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:44.058672 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.wsgi [None req-95fa1005-a2cf-4cd0-a7c5-3fa755d07220 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-95fa1005-a2cf-4cd0-a7c5-3fa755d07220 admin admin] Request method failure captured: Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Accept: application/json Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Accept-Encoding: gzip, deflate Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Connection: keep-alive Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Content-Length: 0 Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Host: 10.222.0.102 Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Openstack-Api-Version: compute 2.90 Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Openstack-System-Scope: None Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: User-Agent: python-novaclient Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Auth-Token: gAAAAABjEOrbATO4Z4QS-lyIJZCnqET22ajujdGSkaE374FeCJ-w2HfyFZckf6MuJ0Ab5NIVYH8642dCLUjUjISmpYhxLdkxragFSgXlTSTVnTbBKJ8Bt60NwGh2rogNTWgkcO7vKZdkTSAxrst701Vgmu1QTdZxD4Aw9yfbWWYi-0m4lqIL-YI Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Domain-Id: None Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Domain-Name: None Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Identity-Status: Confirmed Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Is-Admin-Project: True Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Domain-Id: default Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Domain-Name: Default Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Name: admin Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Role: reader,member,admin Sep 01 17:24:44.061932 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Roles: reader,member,admin Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ace9b3845813477eb192c158600d0beb", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ace9b3845813477eb192c158600d0beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}] Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Tenant: admin Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Tenant-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Tenant-Name: admin Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User: admin Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Domain-Id: default Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Domain-Name: Default Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Id: e6c9197e0f844432a03b9e75fc87712b Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Name: admin Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: method: > Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: exception: Flavor 42 could not be found. Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: action_args: {'id': '42'} Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:24:44.063486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:44.064451 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:44.065720 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-95fa1005-a2cf-4cd0-a7c5-3fa755d07220 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:24:44.067443 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-95fa1005-a2cf-4cd0-a7c5-3fa755d07220 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014980 Sep 01 17:24:44.067443 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 21/42] 10.222.0.102 () {60 vars in 1195 bytes} [Thu Sep 1 17:24:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 17:24:45.029760 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-2575a057-b07b-4e62-a719-255a0ddd154e admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:45.030770 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-2575a057-b07b-4e62-a719-255a0ddd154e admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001472 Sep 01 17:24:45.031165 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 22/43] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:24:45 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:45.556030 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-b9118681-88d1-487c-9a92-9758cd8ec4a6 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:45.561440 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.wsgi [None req-b9118681-88d1-487c-9a92-9758cd8ec4a6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-b9118681-88d1-487c-9a92-9758cd8ec4a6 admin admin] Request method failure captured: Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Accept: application/json Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Accept-Encoding: gzip, deflate Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Connection: keep-alive Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Content-Length: 0 Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Host: 10.222.0.102 Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Openstack-Api-Version: compute 2.90 Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Openstack-System-Scope: None Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: User-Agent: python-novaclient Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Auth-Token: gAAAAABjEOrc4RSIOIMpDMlKr_y4BAl7-d2A1yePIHAegAQNcydzehOOnEXQfe5BLz9C2sdIqFFraMhBIOhPxnLPcFBBwEiHeWyQNukHghhnp5g5dFlTW-8HZK3qMg3nCMNfcGapRBgnY9A_DR2fc2v0Ty7onDd2KQKF-i06ivP2WGlNNtSQL5c Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Domain-Id: None Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Domain-Name: None Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Identity-Status: Confirmed Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Is-Admin-Project: True Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Domain-Id: default Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Domain-Name: Default Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Name: admin Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Role: reader,member,admin Sep 01 17:24:45.562958 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Roles: reader,member,admin Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ace9b3845813477eb192c158600d0beb", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ace9b3845813477eb192c158600d0beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}] Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Tenant: admin Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Tenant-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Tenant-Name: admin Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User: admin Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Domain-Id: default Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Domain-Name: Default Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Id: e6c9197e0f844432a03b9e75fc87712b Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Name: admin Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: method: > Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: exception: Flavor 84 could not be found. Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: action_args: {'id': '84'} Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:24:45.564432 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:45.565519 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.566955 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-b9118681-88d1-487c-9a92-9758cd8ec4a6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:24:45.568287 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-b9118681-88d1-487c-9a92-9758cd8ec4a6 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397686 Sep 01 17:24:45.568287 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 22/44] 10.222.0.102 () {60 vars in 1195 bytes} [Thu Sep 1 17:24:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:45.574341 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-d48e2d27-5252-46e2-bf7a-85bd9d26881e admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:45.589572 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-d48e2d27-5252-46e2-bf7a-85bd9d26881e admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019083 Sep 01 17:24:45.590114 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 23/45] 10.222.0.102 () {60 vars in 1215 bytes} [Thu Sep 1 17:24:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:24:45.600516 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-5bfbee47-604f-43c3-baec-3accccf63ea1 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:45.616195 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-5bfbee47-604f-43c3-baec-3accccf63ea1 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019979 Sep 01 17:24:45.616728 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 23/46] 10.222.0.102 () {60 vars in 1215 bytes} [Thu Sep 1 17:24:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:24:45.625858 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-c6805248-15a4-4a09-bd80-56407228ab59 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:45.631119 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.wsgi [None req-c6805248-15a4-4a09-bd80-56407228ab59 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-c6805248-15a4-4a09-bd80-56407228ab59 admin admin] Request method failure captured: Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Accept: application/json Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Accept-Encoding: gzip, deflate Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Connection: keep-alive Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Content-Length: 0 Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Host: 10.222.0.102 Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Openstack-Api-Version: compute 2.90 Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Openstack-System-Scope: None Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: User-Agent: python-novaclient Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Auth-Token: gAAAAABjEOrc4RSIOIMpDMlKr_y4BAl7-d2A1yePIHAegAQNcydzehOOnEXQfe5BLz9C2sdIqFFraMhBIOhPxnLPcFBBwEiHeWyQNukHghhnp5g5dFlTW-8HZK3qMg3nCMNfcGapRBgnY9A_DR2fc2v0Ty7onDd2KQKF-i06ivP2WGlNNtSQL5c Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Domain-Id: None Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Domain-Name: None Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Identity-Status: Confirmed Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Is-Admin-Project: True Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Domain-Id: default Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Domain-Name: Default Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Name: admin Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Role: reader,member,admin Sep 01 17:24:45.632614 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Roles: reader,member,admin Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ace9b3845813477eb192c158600d0beb", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ace9b3845813477eb192c158600d0beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}] Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Tenant: admin Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Tenant-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Tenant-Name: admin Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User: admin Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Domain-Id: default Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Domain-Name: Default Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Id: e6c9197e0f844432a03b9e75fc87712b Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Name: admin Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: method: > Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: exception: Flavor 84 could not be found. Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: action_args: {'id': '84'} Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:24:45.634256 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:45.635185 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:45.636675 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-c6805248-15a4-4a09-bd80-56407228ab59 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:24:45.637983 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-c6805248-15a4-4a09-bd80-56407228ab59 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011612 Sep 01 17:24:45.637983 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 24/47] 10.222.0.102 () {60 vars in 1195 bytes} [Thu Sep 1 17:24:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:46.596954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-5bfbee47-604f-43c3-baec-3accccf63ea1 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:46.598030 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-5bfbee47-604f-43c3-baec-3accccf63ea1 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001529 Sep 01 17:24:46.598425 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 24/48] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:24:46 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:47.120969 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-a2e14174-755c-4b31-b9a7-017d31a04a56 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:47.126701 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.wsgi [None req-a2e14174-755c-4b31-b9a7-017d31a04a56 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-a2e14174-755c-4b31-b9a7-017d31a04a56 admin admin] Request method failure captured: Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Accept: application/json Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Accept-Encoding: gzip, deflate Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Connection: keep-alive Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Content-Length: 0 Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Host: 10.222.0.102 Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Openstack-Api-Version: compute 2.90 Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Openstack-System-Scope: None Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: User-Agent: python-novaclient Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Auth-Token: gAAAAABjEOrelCg5ME4PS9Z5TiXOT_GYLc4SWGcAtw6daSSdAfG4LP1VNE8dv7sWns-rsL5RPegKv5MRZeR-PPnr0ooXI9sRncH32codU-wteY2VvPK-iAlCKGRAewXtebFyeJV34O0vh0w4Wxe2TTfwS9JfyOSU6I2MVkOzZLiK-KOVqDpPa4c Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Domain-Id: None Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Domain-Name: None Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Identity-Status: Confirmed Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Is-Admin-Project: True Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Domain-Id: default Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Domain-Name: Default Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Project-Name: admin Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Role: reader,member,admin Sep 01 17:24:47.128186 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Roles: reader,member,admin Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ace9b3845813477eb192c158600d0beb", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ace9b3845813477eb192c158600d0beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}] Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Tenant: admin Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Tenant-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-Tenant-Name: admin Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User: admin Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Domain-Id: default Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Domain-Name: Default Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Id: e6c9197e0f844432a03b9e75fc87712b Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: X-User-Name: admin Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: method: > Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: exception: Flavor 451 could not be found. Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: action_args: {'id': '451'} Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:24:47.129888 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:47.130814 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.132200 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-a2e14174-755c-4b31-b9a7-017d31a04a56 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:24:47.133605 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-a2e14174-755c-4b31-b9a7-017d31a04a56 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395119 Sep 01 17:24:47.133605 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 25/49] 10.222.0.102 () {60 vars in 1198 bytes} [Thu Sep 1 17:24:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:47.139312 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-034fb5b2-31f6-4c7a-898f-7c3ca500d2b0 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:47.154486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-034fb5b2-31f6-4c7a-898f-7c3ca500d2b0 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018844 Sep 01 17:24:47.155030 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 25/50] 10.222.0.102 () {60 vars in 1215 bytes} [Thu Sep 1 17:24:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:24:47.165202 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:47.181412 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019823 Sep 01 17:24:47.181961 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 26/51] 10.222.0.102 () {60 vars in 1215 bytes} [Thu Sep 1 17:24:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:24:47.191367 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-f30955b1-67b8-4889-be72-60ebad1a5439 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:47.196612 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.wsgi [None req-f30955b1-67b8-4889-be72-60ebad1a5439 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-f30955b1-67b8-4889-be72-60ebad1a5439 admin admin] Request method failure captured: Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Accept: application/json Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Accept-Encoding: gzip, deflate Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Connection: keep-alive Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Content-Length: 0 Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Host: 10.222.0.102 Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Openstack-Api-Version: compute 2.90 Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Openstack-System-Scope: None Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: User-Agent: python-novaclient Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Auth-Token: gAAAAABjEOrelCg5ME4PS9Z5TiXOT_GYLc4SWGcAtw6daSSdAfG4LP1VNE8dv7sWns-rsL5RPegKv5MRZeR-PPnr0ooXI9sRncH32codU-wteY2VvPK-iAlCKGRAewXtebFyeJV34O0vh0w4Wxe2TTfwS9JfyOSU6I2MVkOzZLiK-KOVqDpPa4c Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Domain-Id: None Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Domain-Name: None Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Identity-Status: Confirmed Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Is-Admin-Project: True Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Domain-Id: default Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Domain-Name: Default Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Project-Name: admin Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Role: reader,member,admin Sep 01 17:24:47.198372 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Roles: reader,member,admin Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_ace9b3845813477eb192c158600d0beb", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/ace9b3845813477eb192c158600d0beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/ace9b3845813477eb192c158600d0beb"}]}] Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Tenant: admin Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Tenant-Id: ace9b3845813477eb192c158600d0beb Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-Tenant-Name: admin Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User: admin Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Domain-Id: default Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Domain-Name: Default Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Id: e6c9197e0f844432a03b9e75fc87712b Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: X-User-Name: admin Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: method: > Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: exception: Flavor 451 could not be found. Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: action_args: {'id': '451'} Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:24:47.199954 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:47.200910 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: ERROR nova.api.openstack.wsgi Sep 01 17:24:47.202469 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-f30955b1-67b8-4889-be72-60ebad1a5439 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105480) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:24:47.203667 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-f30955b1-67b8-4889-be72-60ebad1a5439 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011719 Sep 01 17:24:47.203667 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 26/52] 10.222.0.102 () {60 vars in 1198 bytes} [Thu Sep 1 17:24:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:24:48.172647 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:48.173681 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001449 Sep 01 17:24:48.174080 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 27/53] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:24:48 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:48.700734 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-9b9a65c6-f44b-4285-9d78-78f79c5bba51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:48.722386 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-9b9a65c6-f44b-4285-9d78-78f79c5bba51 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.411423 Sep 01 17:24:48.722937 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 27/54] 10.222.0.102 () {64 vars in 1240 bytes} [Thu Sep 1 17:24:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:24:49.696910 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:49.697952 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001468 Sep 01 17:24:49.698375 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 28/55] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:24:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:50.245564 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-524a58d5-d7e7-4c44-a984-c1f3007957d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:50.266386 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-524a58d5-d7e7-4c44-a984-c1f3007957d1 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.426306 Sep 01 17:24:50.267144 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 28/56] 10.222.0.102 () {64 vars in 1240 bytes} [Thu Sep 1 17:24:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:24:51.239458 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:51.240473 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001534 Sep 01 17:24:51.240874 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 29/57] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:24:51 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:51.776869 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-c9c89772-97d5-46df-af21-0d3309261a26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:51.795835 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-c9c89772-97d5-46df-af21-0d3309261a26 admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407855 Sep 01 17:24:51.796387 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 29/58] 10.222.0.102 () {64 vars in 1240 bytes} [Thu Sep 1 17:24:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:24:52.771190 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:52.772203 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002002 Sep 01 17:24:52.772599 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 30/59] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:24:52 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:53.291604 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-60c78875-74d4-473b-817a-2bdc56e95eef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:24:53.311089 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-60c78875-74d4-473b-817a-2bdc56e95eef admin admin] 10.222.0.102 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.400516 Sep 01 17:24:53.311644 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 30/60] 10.222.0.102 () {64 vars in 1240 bytes} [Thu Sep 1 17:24:52 2022] POST /compute/v2.1/flavors => generated 411 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:24:54.283604 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:54.284672 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001461 Sep 01 17:24:54.285027 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 31/61] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:24:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:24:54.811419 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-cd9572b6-d462-49fd-98c4-9bd2278fca8a admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:24:54.832320 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-cd9572b6-d462-49fd-98c4-9bd2278fca8a admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.411118 Sep 01 17:24:54.832862 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 31/62] 10.222.0.102 () {60 vars in 1207 bytes} [Thu Sep 1 17:24:54 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:25:48.600269 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:25:48.602051 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-06ceb74a-ac74-42d7-a5e6-b6a7e07385c0 admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002437 Sep 01 17:25:48.603300 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 32/63] 10.222.0.102 () {54 vars in 936 bytes} [Thu Sep 1 17:25:48 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:25:48.612459 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:25:49.007606 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-617c4e64-477c-4d21-a7a1-bb75335213da admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:25:49.028808 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-617c4e64-477c-4d21-a7a1-bb75335213da admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.417098 Sep 01 17:25:49.029291 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 32/64] 10.222.0.102 () {60 vars in 1297 bytes} [Thu Sep 1 17:25:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:25:49.050839 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG dbcounter [-] [105479] Writing DB stats nova_api:SELECT=14 {{(pid=105479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:25:49.054645 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-4b8c1f0f-39b2-4b05-b8f4-bc18fb795220 admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:25:49.062923 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-4b8c1f0f-39b2-4b05-b8f4-bc18fb795220 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013540 Sep 01 17:25:49.063457 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 33/65] 10.222.0.102 () {60 vars in 1288 bytes} [Thu Sep 1 17:25:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:25:49.075186 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-c96b5532-8441-41d2-bb3e-90ee2d03702a admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:25:49.082879 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-c96b5532-8441-41d2-bb3e-90ee2d03702a admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011360 Sep 01 17:25:49.083410 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 33/66] 10.222.0.102 () {60 vars in 1291 bytes} [Thu Sep 1 17:25:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:25:49.096118 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:25:49.104274 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011887 Sep 01 17:25:49.104792 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 34/67] 10.222.0.102 () {60 vars in 1291 bytes} [Thu Sep 1 17:25:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:25:49.116842 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-66ca46c3-5d8e-4089-8819-ebccca7bc227 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:25:49.124552 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-66ca46c3-5d8e-4089-8819-ebccca7bc227 admin admin] 10.222.0.102 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011341 Sep 01 17:25:49.125083 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 34/68] 10.222.0.102 () {60 vars in 1288 bytes} [Thu Sep 1 17:25:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:28:52.063230 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:28:52.064799 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001457 Sep 01 17:28:52.065199 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 35/69] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:28:52 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:28:52.204914 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=6 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:28:52.360972 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-c5059fe1-8c20-4a3b-b92f-96d80da0aee7 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:28:52.364567 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-c5059fe1-8c20-4a3b-b92f-96d80da0aee7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:28:52.365032 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-c5059fe1-8c20-4a3b-b92f-96d80da0aee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:28:52.365486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-c5059fe1-8c20-4a3b-b92f-96d80da0aee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:28:52.366194 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-c5059fe1-8c20-4a3b-b92f-96d80da0aee7 admin admin] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:28:52.366634 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-c5059fe1-8c20-4a3b-b92f-96d80da0aee7 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:28:52.367040 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-c5059fe1-8c20-4a3b-b92f-96d80da0aee7 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:28:52.401544 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-c5059fe1-8c20-4a3b-b92f-96d80da0aee7 admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198628 Sep 01 17:28:52.402121 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 35/70] 10.222.0.102 () {60 vars in 1198 bytes} [Thu Sep 1 17:28:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:28:53.225110 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:28:53.226134 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001435 Sep 01 17:28:53.226533 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 36/71] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:28:53 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:28:53.417436 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-4af445a7-6d3f-4c58-b1fa-30c4999e0d00 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:28:53.420794 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-4af445a7-6d3f-4c58-b1fa-30c4999e0d00 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:28:53.421269 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-4af445a7-6d3f-4c58-b1fa-30c4999e0d00 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:28:53.421726 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-4af445a7-6d3f-4c58-b1fa-30c4999e0d00 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:28:53.422449 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-4af445a7-6d3f-4c58-b1fa-30c4999e0d00 admin admin] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:28:53.422893 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-4af445a7-6d3f-4c58-b1fa-30c4999e0d00 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:28:53.423311 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-4af445a7-6d3f-4c58-b1fa-30c4999e0d00 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:28:53.443168 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-4af445a7-6d3f-4c58-b1fa-30c4999e0d00 admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077551 Sep 01 17:28:53.443659 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 36/72] 10.222.0.102 () {60 vars in 1198 bytes} [Thu Sep 1 17:28:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:04.676538 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:04.677618 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001478 Sep 01 17:29:04.678020 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 37/73] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:29:04 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:04.828576 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell0:SELECT=4 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:04.829325 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell1:SELECT=4 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:04.830444 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=8 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:04.880337 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-61485b1d-d146-495d-a522-b705a1cfc951 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:04.883724 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-61485b1d-d146-495d-a522-b705a1cfc951 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:29:04.884253 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-61485b1d-d146-495d-a522-b705a1cfc951 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:29:04.884633 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-61485b1d-d146-495d-a522-b705a1cfc951 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:29:04.885378 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-61485b1d-d146-495d-a522-b705a1cfc951 admin admin] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:29:04.885828 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-61485b1d-d146-495d-a522-b705a1cfc951 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:29:04.886246 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-61485b1d-d146-495d-a522-b705a1cfc951 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:29:04.905841 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-61485b1d-d146-495d-a522-b705a1cfc951 admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081922 Sep 01 17:29:04.906386 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 37/74] 10.222.0.102 () {60 vars in 1198 bytes} [Thu Sep 1 17:29:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:05.731719 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:05.732722 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001458 Sep 01 17:29:05.733162 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 38/75] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:29:05 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:05.922759 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-a4aebc7e-49f3-4e1f-bcc4-b8f2bd031a1a admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:05.926109 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a4aebc7e-49f3-4e1f-bcc4-b8f2bd031a1a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:29:05.926586 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a4aebc7e-49f3-4e1f-bcc4-b8f2bd031a1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:29:05.927012 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a4aebc7e-49f3-4e1f-bcc4-b8f2bd031a1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:29:05.927726 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a4aebc7e-49f3-4e1f-bcc4-b8f2bd031a1a admin admin] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:29:05.928170 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a4aebc7e-49f3-4e1f-bcc4-b8f2bd031a1a admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:29:05.928585 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a4aebc7e-49f3-4e1f-bcc4-b8f2bd031a1a admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:29:05.948230 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-a4aebc7e-49f3-4e1f-bcc4-b8f2bd031a1a admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076550 Sep 01 17:29:05.948715 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 38/76] 10.222.0.102 () {60 vars in 1198 bytes} [Thu Sep 1 17:29:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:29:17.244073 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:17.245091 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001446 Sep 01 17:29:17.245607 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 39/77] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:29:17 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:17.393953 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell0:SELECT=4 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:17.394669 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_cell1:SELECT=4 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:17.395314 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG dbcounter [-] [105480] Writing DB stats nova_api:SELECT=8 {{(pid=105480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:29:17.442327 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-6e9f40d5-cd44-4589-8815-53b46761e5d2 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:17.445755 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-6e9f40d5-cd44-4589-8815-53b46761e5d2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:29:17.446250 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-6e9f40d5-cd44-4589-8815-53b46761e5d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:29:17.446671 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-6e9f40d5-cd44-4589-8815-53b46761e5d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:29:17.447377 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-6e9f40d5-cd44-4589-8815-53b46761e5d2 admin admin] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:29:17.447818 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-6e9f40d5-cd44-4589-8815-53b46761e5d2 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:29:17.448227 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-6e9f40d5-cd44-4589-8815-53b46761e5d2 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:29:17.474486 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-6e9f40d5-cd44-4589-8815-53b46761e5d2 admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085503 Sep 01 17:29:17.474964 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 39/78] 10.222.0.102 () {60 vars in 1198 bytes} [Thu Sep 1 17:29:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:29:18.300768 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: DEBUG nova.api.openstack.wsgi [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] Calling method '>' {{(pid=105479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:18.301816 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: INFO nova.api.openstack.requestlog [None req-9d01de97-7a63-437f-abfd-2dd0bcd78bca admin admin] 10.222.0.102 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001496 Sep 01 17:29:18.302216 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: [pid: 105479|app: 0|req: 40/79] 10.222.0.102 () {56 vars in 1079 bytes} [Thu Sep 1 17:29:18 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:29:18.501655 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG nova.api.openstack.wsgi [None req-a57f4a82-8401-48b9-91a0-835dbc547a44 admin admin] Calling method '>' {{(pid=105480) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:29:18.505130 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a57f4a82-8401-48b9-91a0-835dbc547a44 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:29:18.505579 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a57f4a82-8401-48b9-91a0-835dbc547a44 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:29:18.506008 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a57f4a82-8401-48b9-91a0-835dbc547a44 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:29:18.506721 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a57f4a82-8401-48b9-91a0-835dbc547a44 admin admin] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:29:18.507168 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a57f4a82-8401-48b9-91a0-835dbc547a44 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:29:18.507582 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: DEBUG oslo_concurrency.lockutils [None req-a57f4a82-8401-48b9-91a0-835dbc547a44 admin admin] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105480) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:29:18.529267 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: INFO nova.api.openstack.requestlog [None req-a57f4a82-8401-48b9-91a0-835dbc547a44 admin admin] 10.222.0.102 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081478 Sep 01 17:29:18.529859 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: [pid: 105480|app: 0|req: 40/80] 10.222.0.102 () {60 vars in 1198 bytes} [Thu Sep 1 17:29:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:30:24.322018 dv-cinder-852211-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 17:30:24.322556 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: Thu Sep 1 17:30:24 2022 - graceful shutdown triggered... Sep 01 17:30:24.322979 dv-cinder-852211-8-iscsi devstack@n-api.service[105479]: Gracefully killing worker 1 (pid: 105479)... Sep 01 17:30:24.323342 dv-cinder-852211-8-iscsi devstack@n-api.service[105480]: Gracefully killing worker 2 (pid: 105480)... Sep 01 17:30:25.323728 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: worker 1 buried after 1 seconds Sep 01 17:30:25.324320 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: worker 2 buried after 1 seconds Sep 01 17:30:25.324320 dv-cinder-852211-8-iscsi devstack@n-api.service[105478]: goodbye to uWSGI. Sep 01 17:30:25.325372 dv-cinder-852211-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 17:30:25.325955 dv-cinder-852211-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 17:30:25.328758 dv-cinder-852211-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 17:30:25.339562 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 17:30:25 2022] *** Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: nodename: dv-cinder-852211-8-iscsi Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: machine: x86_64 Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: clock source: unix Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: pcre jit disabled Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: detected number of CPU cores: 4 Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: current working directory: / Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: detected binary path: /usr/bin/uwsgi-core Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: your processes number limit is 47680 Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: your memory page size is 4096 bytes Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: detected max file descriptor number: 2048 Sep 01 17:30:25.344134 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: lock engine: pthread robust mutexes Sep 01 17:30:25.345237 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: thunder lock: enabled Sep 01 17:30:25.345237 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 17:30:25.345237 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 17:30:25.384152 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: Python main interpreter initialized at 0x563f02e149c0 Sep 01 17:30:25.384152 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: python threads support enabled Sep 01 17:30:25.384152 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: your server socket listen backlog is limited to 100 connections Sep 01 17:30:25.384152 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: your mercy for graceful operations on workers is 90 seconds Sep 01 17:30:25.384583 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 17:30:25.384583 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: *** Operational MODE: preforking *** Sep 01 17:30:25.384880 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: *** uWSGI is running in multiple interpreter mode *** Sep 01 17:30:25.384880 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: spawned uWSGI master process (pid: 121725) Sep 01 17:30:25.385082 dv-cinder-852211-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 17:30:25.386968 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: spawned uWSGI worker 1 (pid: 121744, cores: 1) Sep 01 17:30:25.386968 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: spawned uWSGI worker 2 (pid: 121745, cores: 1) Sep 01 17:30:25.386968 dv-cinder-852211-8-iscsi devstack@n-api.service[121725]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 17:30:26.051993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:30:26.052659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:30:27.215324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:30:27.215324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: from cryptography.utils import int_from_bytes Sep 01 17:30:27.216059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:30:27.216059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: from cryptography.utils import int_from_bytes Sep 01 17:30:27.219143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:30:27.219143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: from cryptography.utils import int_from_bytes Sep 01 17:30:27.219602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:30:27.219602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: from cryptography.utils import int_from_bytes Sep 01 17:30:29.676953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:30:29.677575 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:30:29.677859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:30:29.678138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:30:29.678395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:30:29.678781 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.679108 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.679427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.679746 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.680073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.680385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.680705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.681021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.681367 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.681631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.681934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.682261 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-8-iscsi {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.682763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.683079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.683393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.683716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.684027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.684459 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.684768 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.685275 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.686685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.686685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.686685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.687084 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.687307 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.687631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.687943 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.688249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.689185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.689539 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.689945 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-8-iscsi {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.690369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.690686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.691006 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.691416 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.691736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.692032 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.692364 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.692681 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.693003 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.693335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.693653 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.693971 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.694288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.694588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.694893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.695199 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.695517 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.695835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.696119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.696372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.696702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.697809 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.697809 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.697809 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.698028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.698189 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.698439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.698715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.699021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.699324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.699625 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.699943 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.700231 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.700533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.700833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.701134 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.701480 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.701792 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.702111 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.702792 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.702946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.703825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.704423 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.704941 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.705519 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.706165 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.706693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.707340 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.707866 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.708383 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.708917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.709426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.709760 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.710104 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.710415 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.710668 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.710975 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.711287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.711606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.711917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.712223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.712527 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.712824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.713126 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.713452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.713761 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.714066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.714372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.714676 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.714980 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.715284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.715585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.715888 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.716212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.716531 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.716836 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.717140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.717469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.717775 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.718096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.718399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.718702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.718801 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:30:29.719239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.719338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:30:29.719425 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.719619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:30:29.719735 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.719940 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.720034 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:30:29.720214 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:30:29.720332 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.720569 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.720685 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.720890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.721008 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.721190 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.721374 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.721515 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.721622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.721832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.721935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.722134 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.722253 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.722436 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.722539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.722992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.723097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.723292 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.723398 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.723592 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.723696 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.723891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.723991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.724189 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.724292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-8-iscsi {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.724488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.724710 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.724810 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.725024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.725126 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.725440 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.725556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.725686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.725805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.725993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.726119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.726303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.726404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.726614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.726718 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.726953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.727119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.727281 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.727422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.727609 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.727713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.727920 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.728020 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.728249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.728350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.728576 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.728684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.728890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.729007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.729198 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.729317 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.729559 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.729665 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.729890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.729999 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.730197 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.730314 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.730541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.730673 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-8-iscsi {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.730849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.730976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.731166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.731268 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.731480 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.731579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.731806 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.731912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.732118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.732215 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.732429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.732535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.732741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.732839 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.733048 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.733153 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.733386 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.733484 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.733716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.733834 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.734037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.734144 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.734347 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.734551 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.734688 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.734808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.734990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.735147 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.735304 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.735950 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.736223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.736374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.736475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.736571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.736758 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.736865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.737064 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.737171 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.737335 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.737451 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.737712 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.737820 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.738033 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.738137 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.738361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.738469 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.738653 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.738761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.738909 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.739009 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.739168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.739289 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.739467 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.739581 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.739795 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.739920 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.740108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.740207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.740423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.740686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.740783 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.740868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.741021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.741208 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.741336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.741659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.741769 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.741854 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.741926 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.742139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.742244 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.742449 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.742555 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.742764 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.742870 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.743075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.743172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.743383 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.743491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.743690 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.743798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.743990 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.744144 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.102 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.744292 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.744438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.102 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.744592 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.744700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.744900 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.745003 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.745201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.745339 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.745626 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.745729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.745957 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.746085 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.746267 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.746375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.746575 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.746668 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.746884 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.746983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.747189 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.747334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.747497 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.747594 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.747805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.747941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.748106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.748207 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.748391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.748532 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.748655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.748779 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.748962 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.749066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.749283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.749439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.749614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.749720 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.749919 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.750018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.750223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.750327 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.750525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.750628 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.750827 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.750938 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.751778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.751899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.751996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.752082 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.752307 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.752414 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.752614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.752717 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.752921 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.753025 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.753229 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.753412 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.753563 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.753672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.754013 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.754151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.754151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.754335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.754472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.754575 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.754789 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.754936 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.755096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.755189 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.755403 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.755504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.755711 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.755812 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.756011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.756102 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.756322 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.756425 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.756623 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.756723 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.756922 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.757016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.757222 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.757354 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.757564 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.757671 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.757874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.758004 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.758202 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.758426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.758521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.758989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.759099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.759515 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.759627 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.759822 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.759917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.760134 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.760294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.760460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.760610 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.760748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.760846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.761069 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.761166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.761430 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.761549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.761736 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.761852 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.762052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.762235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.762411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.762557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.762713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.762856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.763009 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.763155 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.763314 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.763495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.763636 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.763789 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.763956 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.764133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.764294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.764432 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.764568 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.765363 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.765479 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.765575 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.765741 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:30:29.765877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.765993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.766105 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.766224 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.766348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.766348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.766574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.766695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.766790 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.766875 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.767022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.767114 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.767246 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.767343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.767437 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.767534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.767634 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.767826 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.767999 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.768164 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.768495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.768594 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.768807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.768932 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.769127 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.769256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.769457 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.769604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.769769 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.769930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.770075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.770257 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.770381 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.770594 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.770691 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.770922 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.771014 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.771242 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.771338 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.771565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.771662 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.771876 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.772027 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.772284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.772399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.772594 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.772871 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.773008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.773142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.773142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.773434 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.773566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.773778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.773902 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.774363 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.774521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.774647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.774792 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.774918 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.775057 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.775172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.775283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.775409 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.775530 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.775642 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.775776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.775956 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.776087 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.776264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.776387 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.776599 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.776724 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.776919 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.777056 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.777404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.777739 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.778061 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.778362 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.778480 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.778676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.778776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.778993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.779095 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.779307 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.779458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.779706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.779857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.779975 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.780068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.780243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.780374 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.780576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.780675 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.780899 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.781045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.781223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.781351 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.781577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.781675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.781906 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.781989 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.782266 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.782378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.782578 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.782684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.782987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.783182 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.783391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.783510 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.783601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.783695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.783832 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.783925 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.784161 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.784293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.784601 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.784705 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.784800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.784910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.785046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.785168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.785411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.785523 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.785724 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.785839 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.786028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.786182 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.786349 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.786456 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.786657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.786749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.786969 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.787084 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.787333 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.787465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.787585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.787677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.787893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.787999 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.788212 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.788316 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.788537 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.788633 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.788880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.788975 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.789196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.789297 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.789538 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.789642 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.789848 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.789941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.790158 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.790267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.790468 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.790570 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.791222 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.791323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.791473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.791565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.791649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.791748 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.791841 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.791927 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.792017 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.792132 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.792251 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.792451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.792654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.792835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.792969 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.793166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.793361 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.793523 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.793620 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.793828 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.793935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.794171 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.794276 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.794507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.794744 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.794864 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.794967 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.795119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.795235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.795427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.795531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.795730 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.795825 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.796034 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.796139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.796339 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.796437 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.796639 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.796746 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.796942 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.797036 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.797243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.797435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.797579 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.797686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.798366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.798472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.798682 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.798780 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.798984 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.799088 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.799286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.799384 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.799586 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.799708 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.799886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.799979 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.800197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.800299 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.800497 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.800600 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.800805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.800907 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.801106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.801257 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.801452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.801581 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.801758 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.801861 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.802059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.802161 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.802361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.802508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.802660 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.802762 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.802998 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.803099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.803298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.803392 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.803635 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.803739 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.803961 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.804061 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.804272 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.804374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.804587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.804747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.804896 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.804986 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.805194 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.805290 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.805520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.805615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.805820 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.805927 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.806119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.806220 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.806425 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.806522 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.806735 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.806838 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.807819 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.807970 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.808087 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.808199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.808319 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.808444 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.808444 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.808838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.811323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.811486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.811486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.811763 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.811901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.812017 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.812129 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.812525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.814767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.814928 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.815058 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.815176 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.815288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.815288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.815519 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.815643 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.815765 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.815879 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.815991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.816110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.816244 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.816364 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.816364 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.816364 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.816730 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.816730 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.816974 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.817095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.817216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.817216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.819100 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.819100 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.819376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.819500 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.819618 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.819746 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.819869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.820019 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.820135 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.820264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.820377 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.821033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.821147 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.821243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.821410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.821545 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.821648 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.821734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.821848 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.821951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.822038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.822172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.822312 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.822430 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.822530 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.822628 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.822715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.822802 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.822903 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823090 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823371 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823462 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823848 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.823949 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824050 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824239 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824499 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824499 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824905 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.824992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.825090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.825260 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.825473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.825603 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.825706 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.825800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.825893 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.825979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.826082 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.826212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.826414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.826516 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.826611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.826697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.826849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.826978 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.827111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.827238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.827352 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.827454 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.827555 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.827661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.827753 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.827876 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.827987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.828108 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.828221 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.828348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.828468 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.828561 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.828645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.828806 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.828902 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.828997 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.829088 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.829272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.829473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.829588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.829683 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.829811 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.829954 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830093 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830184 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830283 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830370 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830460 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830553 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830645 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.830918 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831177 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831307 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831564 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831656 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831656 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831870 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.831954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832037 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832188 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832266 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832347 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.832916 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.833057 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.833161 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.833247 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.833388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.833522 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.833615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.833747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.833876 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.834055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.834187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.834363 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.834489 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.834676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.834794 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.834983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.835089 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.835292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.835384 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.835600 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.835694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.835912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.836091 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.836218 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.836400 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.836524 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.836706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.836832 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.837016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.837139 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.837347 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.837473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.837659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.837772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.837974 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.838065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.838287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.838398 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.838587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.838689 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.838976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.839076 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.839283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.839406 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.839651 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.839806 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.840532 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.840641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.840754 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.840848 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.840996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.841106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.841200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.841294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.841414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.841513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.841611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.841698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.841807 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.841909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.842119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.842229 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.842450 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.842569 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.842759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.842886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.843072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.843184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.843380 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.843481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.843691 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.843784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.844004 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.844118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.844314 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.844460 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.844624 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.845295 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.845504 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.845615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.845819 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.845939 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.846132 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.846260 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.846440 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.846583 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.846749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.846891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.847071 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.847221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.847375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.847512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.847948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.848081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.848256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.848379 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.848562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.848694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.848878 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.848999 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.849189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.849339 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.849542 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.849673 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.849857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.849980 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.850164 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.850300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.850484 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.850672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.850790 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.850917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.851091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.851224 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.851398 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.851529 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.851709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.851833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.852021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.852159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.852327 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.852463 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.852652 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.852801 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.853006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.853156 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.853283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.853470 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.853596 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.853719 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.853875 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.854006 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.854181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.854277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.854488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.854595 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.854797 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.854905 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.855102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.855209 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.855404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.855500 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.855705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.855839 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.856018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.856118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.856322 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.856479 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.856613 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.856754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.856912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.857223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.857565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.857777 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.857939 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.858100 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.858279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.858434 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.858607 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.858779 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.858949 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.859123 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.859288 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.859449 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.859633 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.859802 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.859978 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.860134 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.860345 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.860506 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.861088 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.861374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.861657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.861980 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.862199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.862317 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.862530 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.862637 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.862911 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.863033 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.863237 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.863344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.863576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.863703 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.863885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.864029 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.864200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.864317 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.864520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.864615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.864821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.864914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.865125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.865227 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.865573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.865881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.866186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.866384 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.866533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.866725 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.866842 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.867056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.867236 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.867369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.867487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.867672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.867779 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.867994 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.868093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.868296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.868399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.868618 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.868773 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.868927 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.869049 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.869228 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.869408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.869555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.869651 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.869856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.869949 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.870194 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.870297 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.870515 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.870649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.870832 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.870934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.871249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.871351 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.871473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.871629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.871822 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.871914 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.872097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.872201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.872407 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.872508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.872719 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.872827 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.873031 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.873124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.873365 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.873474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.873679 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.873828 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.873986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.874086 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.874290 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.874415 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.874599 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.874708 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.874909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.875003 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.875220 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.875476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.875570 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.875810 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.875912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.876172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.876293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.876483 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.876867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.876972 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.877186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.877289 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.877528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.877637 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.877844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.877940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.878157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.878252 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.878465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.878597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.878773 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.878876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.879083 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.879177 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.879389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.879489 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.879718 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.879888 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.880047 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.880150 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.880384 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.880496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.880703 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.880807 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.881016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.881117 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.881348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.881468 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.881662 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.881756 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.882016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.882108 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.882328 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.882422 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.882629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.882721 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.882937 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.883030 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.883249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.883343 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.883559 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.883696 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.883867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.883957 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.884173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.884305 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.884482 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.884578 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.884790 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.884916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.885103 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.885286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.885429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.885629 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.885734 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.885944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.886041 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.886272 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.886373 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.886597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.886691 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.886925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.887027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.887234 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.887328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.887551 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.887644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.887861 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.887954 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.888187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.888377 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.888515 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.888707 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.888830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.889109 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.889210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.889460 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.889593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.889788 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.889902 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.890104 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.890205 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.890418 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.890559 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.890746 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.890907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.891050 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.891185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.891352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.891475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.894043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.894043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.894407 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.894533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.894648 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.894794 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.894910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.895024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.895151 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.895281 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.895396 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.895519 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.895657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.895773 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.895910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.895910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896139 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896139 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896494 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896595 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896688 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896788 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896788 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.896972 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.897066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.897164 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.897277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.897422 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.897748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.898055 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.898372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.898683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.898985 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.899288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.899600 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.899909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.900212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.900521 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.900817 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.901145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.901484 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.901609 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.901844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.902078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.902197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.902442 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.902541 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.902745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.902844 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.903049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.903185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.903352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.903563 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.903670 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.903948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.904056 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.904249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.904346 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.904556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.904769 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.904876 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.905110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.905216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.905457 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.905578 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.905787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.906112 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.906400 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.906510 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.906780 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.906878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.907118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.907746 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.907990 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.908085 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.908291 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.908387 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.908563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.908671 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.908878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.909042 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.909209 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.909413 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.909522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.909745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.909844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.910101 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.910200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.910460 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.910558 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.910824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.911015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.911183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.911346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.911521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.911863 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.912169 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.912271 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.912501 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.912606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.912824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.912932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.913122 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.913250 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.913535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.913867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.913979 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.914183 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.914289 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.914580 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.914684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.914824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.914952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.915249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.915568 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.915680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.915901 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.916238 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.916410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.916609 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.916945 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.917200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.917427 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.917732 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.917906 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.918080 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.918232 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.918493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.918668 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.918821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.918984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.919144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.919295 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.919444 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.919888 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.920061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.920213 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.920361 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.920522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.920680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.920838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.921002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.921153 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.921368 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.921528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.921679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.921840 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.922073 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.922271 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.922435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.922593 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.922766 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.922986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.923677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.923833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.923982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.924131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.924287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.924451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.924603 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.924851 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.925007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.925157 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.925356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.925531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.925683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.925852 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.926561 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.926806 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.926806 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.927159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.927159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.927159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.927159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.927744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.927924 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.928077 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.928227 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.928377 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.928537 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.928697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.928863 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.929016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.929016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.929299 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.929500 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.929651 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.929904 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.930233 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.930559 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.930865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.931190 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.931467 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.931773 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.931930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.932227 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.932448 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.932608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.932772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.932924 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.933094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.933251 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.934005 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.934369 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.934730 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.935094 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.935256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.935438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.935603 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.935770 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.935921 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.936551 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.936832 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.937089 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.937247 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.937462 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.937626 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.937777 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.937934 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.938085 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.938242 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.938403 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.938588 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.938748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.938898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.939075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.939240 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.939399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.939399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.939693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.939852 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.940002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.940165 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.940322 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.940472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.940628 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.940785 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.940952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.941112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.941112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.941465 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.941627 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.941778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.941934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.942094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.942245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.942445 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.942609 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.942767 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.942931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.943093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.943242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.943242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.943543 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.943699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.943861 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.944012 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.944167 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.944317 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.944465 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.944614 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.944773 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.944931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.945181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.945365 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.945533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.945694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.945694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.945694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.946112 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.946689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.946866 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.947371 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.947533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.947691 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.947855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.948006 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.948155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.948319 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.948319 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.948319 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.948755 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.948915 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.949066 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.949225 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.949412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.949574 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.949731 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.949893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.950053 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.950212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.950363 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.950512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.950512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.950804 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.950968 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.951127 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.951288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.951439 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.951588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.951762 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.951924 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.952077 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.952225 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.952373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.952565 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.952730 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.952881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.953039 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.953198 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.953390 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.953556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.953725 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.953891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.954048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.954239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.954239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.954239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.954683 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.954842 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.955000 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.955178 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.955411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.955577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.955577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.955891 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.956048 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.956199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.956374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:30:29.957021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.957021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.957021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.957021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.957021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.957980 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.957980 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.957980 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.958420 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.958582 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.958797 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.959137 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.959533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.959950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.960326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.960626 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.960940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.961287 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.961686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.962054 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.962380 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.962719 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.963595 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.963923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.964508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.964874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.965208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.965602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.965962 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.966296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.966927 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.967104 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.967282 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.967660 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.967917 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.968261 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.968597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.968937 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.969280 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.969645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.970502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.971149 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.971677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.971677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.972012 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.972160 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.972455 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.973062 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.973456 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.973808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.974152 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.974496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.974813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.975157 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.975499 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.975815 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.976131 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.976469 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.977063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.977259 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.977485 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.977961 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.978293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.978701 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.979011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.979353 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.979691 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.980045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.980383 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.980713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.981049 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.981430 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.981802 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.982158 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.982511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.982861 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.983177 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.983490 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.983826 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.984174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.984512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.984846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.985178 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.986087 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.986421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.986757 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.987317 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.987478 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.987711 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.988068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.988361 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.988717 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.989021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.989364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.989705 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.990040 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.990349 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.990656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.991030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.991365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.991694 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.992058 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.992419 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.992761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.993112 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.993491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.993826 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.994142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.994494 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.994845 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.995195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.995523 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:29.995975 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.001265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.001265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.001265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.001265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.001265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.001265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.001265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.001265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.005903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.005903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.005903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.005903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.005903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.005903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.005903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.005903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.007622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.007622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.007622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.007622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.007622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.007622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.007622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.007622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.008800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.008800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.008800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.008800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.008800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.008800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.008800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.008800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.010043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.010043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.010043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.010043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.010043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:30:30.010043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:30:30.018081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO dbcounter [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Registered counter for database nova_api Sep 01 17:30:30.041123 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_db.sqlalchemy.engines [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:30:30.050324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writer thread running {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:30:30.076246 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO dbcounter [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Registered counter for database nova_api Sep 01 17:30:30.097508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_db.sqlalchemy.engines [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:30:30.104921 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writer thread running {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:30:30.111398 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.context [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bde3a620-b7c5-42e8-8ce6-210f3b120a6d(cell1) {{(pid=121744) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:30:30.115491 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:30:30.116135 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:30:30.117916 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:30:30.118663 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:30:30.119113 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:30:30.121321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:30:30.123346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO dbcounter [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Registered counter for database nova_cell0 Sep 01 17:30:30.127594 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO dbcounter [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Registered counter for database nova_cell1 Sep 01 17:30:30.135938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_db.sqlalchemy.engines [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:30:30.138855 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_db.sqlalchemy.engines [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:30:30.142699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writer thread running {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:30:30.164505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.context [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bde3a620-b7c5-42e8-8ce6-210f3b120a6d(cell1) {{(pid=121745) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:30:30.168878 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:30:30.169377 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:30:30.171057 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:30:30.171838 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:30:30.172330 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:30:30.175119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:30:30.177279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO dbcounter [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Registered counter for database nova_cell0 Sep 01 17:30:30.181591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO dbcounter [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Registered counter for database nova_cell1 Sep 01 17:30:30.189465 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_db.sqlalchemy.engines [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:30:30.191765 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_db.sqlalchemy.engines [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:30:30.197435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writer thread running {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:30:30.199764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writer thread running {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:30:30.285012 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writer thread running {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:30:30.295207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO dbcounter [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Registered counter for database nova_cell0 Sep 01 17:30:30.301994 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_db.sqlalchemy.engines [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:30:30.306391 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writer thread running {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:30:30.357970 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO dbcounter [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Registered counter for database nova_cell0 Sep 01 17:30:30.366394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_db.sqlalchemy.engines [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:30:30.370966 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writer thread running {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:30:30.627683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: WARNING keystonemiddleware.auth_token [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:30:30.634961 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: WARNING keystonemiddleware.auth_token [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:30:30.702049 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: WARNING keystonemiddleware.auth_token [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:30:30.709215 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: WARNING keystonemiddleware.auth_token [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:30:30.981210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: WARNING keystonemiddleware.auth_token [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:30:30.987467 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: WARNING keystonemiddleware.auth_token [None req-eb9f0b2e-d3a9-4854-b7d0-64ceb03b24c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:30:30.992804 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563f02e149c0 pid: 121744 (default app) Sep 01 17:30:31.057328 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: WARNING keystonemiddleware.auth_token [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:30:31.063364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: WARNING keystonemiddleware.auth_token [None req-f05099e4-eedf-4711-9f33-047a665569a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:30:31.068709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f02e149c0 pid: 121745 (default app) Sep 01 17:31:08.117567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:08.124139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:08.125814 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:08.126629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:08.296631 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:08.297911 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:08.299012 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:08.300731 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:09.729903 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c8fda2ac-c3c6-4c55-8e16-5c6f33227c00 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Action: 'create', calling method: .version_select at 0x7fb857754280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-359691964", "metadata": {"Type": "work"}}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c8fda2ac-c3c6-4c55-8e16-5c6f33227c00 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Request method failure captured: Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 121 Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxbgWr45d_jNna7kW1GEvbsy-x5LjSetI16NmkDCO-7XG7eT78jymW0q1TtJsCJpS7UHZHFn9LyYcV_4aZeUcYMeND8Fi503mE1kBnsiEvv2lOvtMO95rS7V4YEH4S4MX2Sg-FtUnHVc3F6zj27auUo7qq_ettHCp6-97KStCC6T9U Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:31:09.759825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_7864c80b2a9b40aeb18e046fe866cf2b", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}] Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 628da841395b4b7e9b3d238c04fe7cee Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-359691964", "metadata": {"Type": "work"}}} Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: Sep 01 17:31:09.761481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-359691964', 'metadata': {'Type': 'work'}}}} Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise error Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:09.762433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 17:31:09.764119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 17:31:09.766277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 17:31:09.766277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.766277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c8fda2ac-c3c6-4c55-8e16-5c6f33227c00 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:09.766277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c8fda2ac-c3c6-4c55-8e16-5c6f33227c00 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.667078 Sep 01 17:31:09.776803 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 1/1] 10.222.0.102 () {60 vars in 1161 bytes} [Thu Sep 1 17:31:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1681 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:31:09.783931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-69607859-d39c-4851-ade4-e1042c3bf0fc tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Action: 'create', calling method: .version_select at 0x7fb857754f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1285934101", "metadata": {"Type": "work"}}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-69607859-d39c-4851-ade4-e1042c3bf0fc tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Request method failure captured: Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 120 Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxbgWr45d_jNna7kW1GEvbsy-x5LjSetI16NmkDCO-7XG7eT78jymW0q1TtJsCJpS7UHZHFn9LyYcV_4aZeUcYMeND8Fi503mE1kBnsiEvv2lOvtMO95rS7V4YEH4S4MX2Sg-FtUnHVc3F6zj27auUo7qq_ettHCp6-97KStCC6T9U Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:31:09.795300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_7864c80b2a9b40aeb18e046fe866cf2b", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}] Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 628da841395b4b7e9b3d238c04fe7cee Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1285934101", "metadata": {"Type": "work"}}} Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: Sep 01 17:31:09.796709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1285934101', 'metadata': {'Type': 'work'}}}} Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise error Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi '0' Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:09.797658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 17:31:09.799079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 17:31:09.803139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 17:31:09.803139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.803139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-69607859-d39c-4851-ade4-e1042c3bf0fc tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:09.803139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-69607859-d39c-4851-ade4-e1042c3bf0fc tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017313 Sep 01 17:31:09.811118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 2/2] 10.222.0.102 () {60 vars in 1161 bytes} [Thu Sep 1 17:31:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:31:09.816584 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f6de6273-4a9d-4600-a8c1-883fc842824e tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Action: 'create', calling method: .version_select at 0x7fb8576b7e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-6480073", "metadata": {"Type": "work"}}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f6de6273-4a9d-4600-a8c1-883fc842824e tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Request method failure captured: Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 116 Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxbgWr45d_jNna7kW1GEvbsy-x5LjSetI16NmkDCO-7XG7eT78jymW0q1TtJsCJpS7UHZHFn9LyYcV_4aZeUcYMeND8Fi503mE1kBnsiEvv2lOvtMO95rS7V4YEH4S4MX2Sg-FtUnHVc3F6zj27auUo7qq_ettHCp6-97KStCC6T9U Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:31:09.827967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_7864c80b2a9b40aeb18e046fe866cf2b", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}] Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 628da841395b4b7e9b3d238c04fe7cee Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-6480073", "metadata": {"Type": "work"}}} Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: Sep 01 17:31:09.830563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-6480073', 'metadata': {'Type': 'work'}}}} Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise error Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi '' Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:09.831647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 17:31:09.835479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 17:31:09.836598 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 17:31:09.836598 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:09.836598 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f6de6273-4a9d-4600-a8c1-883fc842824e tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:09.836598 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f6de6273-4a9d-4600-a8c1-883fc842824e tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018108 Sep 01 17:31:09.840511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 3/3] 10.222.0.102 () {60 vars in 1161 bytes} [Thu Sep 1 17:31:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:31:09.846049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3fe58fd4-4aa5-4b2c-83aa-23cf54688917 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Calling method '.version_select at 0x7fb8577544c0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:09.945234 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6d643b10-eef9-4014-9205-4d7aa4b929df tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Action: 'create', calling method: .version_select at 0x7fb8577551f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1336854863"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:10.523111 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-3fe58fd4-4aa5-4b2c-83aa-23cf54688917 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] HTTP exception thrown: Volume tempest-invalid-872228419 could not be found. Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3fe58fd4-4aa5-4b2c-83aa-23cf54688917 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Request method failure captured: Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-872228419 HTTP/1.1 Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxbgWr45d_jNna7kW1GEvbsy-x5LjSetI16NmkDCO-7XG7eT78jymW0q1TtJsCJpS7UHZHFn9LyYcV_4aZeUcYMeND8Fi503mE1kBnsiEvv2lOvtMO95rS7V4YEH4S4MX2Sg-FtUnHVc3F6zj27auUo7qq_ettHCp6-97KStCC6T9U Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:31:10.527661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_7864c80b2a9b40aeb18e046fe866cf2b", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}] Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 628da841395b4b7e9b3d238c04fe7cee Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Volume tempest-invalid-872228419 could not be found. Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'tempest-invalid-872228419'} Sep 01 17:31:10.529045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-872228419 could not be found. (HTTP 404) (Request-ID: req-48805e29-da93-4b2d-a347-de8b97d08261) Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:10.529897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:31:10.531140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-872228419 could not be found. Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:31:10.532290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-872228419 could not be found. Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-872228419 could not be found. Sep 01 17:31:10.535238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:10.537159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3fe58fd4-4aa5-4b2c-83aa-23cf54688917 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Returning 404 to user: Volume tempest-invalid-872228419 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:10.538287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3fe58fd4-4aa5-4b2c-83aa-23cf54688917 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/tempest-invalid-872228419" status: 404 len: 98 microversion: 2.1 time: 0.696730 Sep 01 17:31:10.539001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 4/4] 10.222.0.102 () {58 vars in 1220 bytes} [Thu Sep 1 17:31:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-872228419 => generated 98 bytes in 698 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 17:31:10.551015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1bf5e2a9-0aab-465f-9ca5-9f83e80ad4ee tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005793 Sep 01 17:31:10.564388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 5/5] 10.222.0.102 () {58 vars in 1145 bytes} [Thu Sep 1 17:31:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 17:31:10.578309 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-eb6616b3-2103-4556-aac2-d91d5a0688a4 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007744 Sep 01 17:31:10.579603 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 6/6] 10.222.0.102 () {58 vars in 1142 bytes} [Thu Sep 1 17:31:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 17:31:10.598369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d6de29d9-625c-48b9-bc21-5f22229e33c7 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Calling method '.version_select at 0x7fb85754b160>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:11.117728 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-d6de29d9-625c-48b9-bc21-5f22229e33c7 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] HTTP exception thrown: Volume d6cfd1d3-401a-4c70-8d22-f4cc35a46e20 could not be found. Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d6de29d9-625c-48b9-bc21-5f22229e33c7 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Request method failure captured: Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: DELETE /compute/v2.1/os-volumes/d6cfd1d3-401a-4c70-8d22-f4cc35a46e20 HTTP/1.1 Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxbgWr45d_jNna7kW1GEvbsy-x5LjSetI16NmkDCO-7XG7eT78jymW0q1TtJsCJpS7UHZHFn9LyYcV_4aZeUcYMeND8Fi503mE1kBnsiEvv2lOvtMO95rS7V4YEH4S4MX2Sg-FtUnHVc3F6zj27auUo7qq_ettHCp6-97KStCC6T9U Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:31:11.120577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_7864c80b2a9b40aeb18e046fe866cf2b", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}] Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 628da841395b4b7e9b3d238c04fe7cee Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Volume d6cfd1d3-401a-4c70-8d22-f4cc35a46e20 could not be found. Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'd6cfd1d3-401a-4c70-8d22-f4cc35a46e20'} Sep 01 17:31:11.122124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6cfd1d3-401a-4c70-8d22-f4cc35a46e20 could not be found. (HTTP 404) (Request-ID: req-c0ed1c77-8b8a-4c00-b7ec-6fc2753cbec1) Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:11.122878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:31:11.128162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6cfd1d3-401a-4c70-8d22-f4cc35a46e20 could not be found. Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 17:31:11.129218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6cfd1d3-401a-4c70-8d22-f4cc35a46e20 could not be found. Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6cfd1d3-401a-4c70-8d22-f4cc35a46e20 could not be found. Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d6de29d9-625c-48b9-bc21-5f22229e33c7 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Returning 404 to user: Volume d6cfd1d3-401a-4c70-8d22-f4cc35a46e20 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d6de29d9-625c-48b9-bc21-5f22229e33c7 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/d6cfd1d3-401a-4c70-8d22-f4cc35a46e20" status: 404 len: 109 microversion: 2.1 time: 0.537577 Sep 01 17:31:11.130438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 7/7] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:31:10 2022] DELETE /compute/v2.1/os-volumes/d6cfd1d3-401a-4c70-8d22-f4cc35a46e20 => generated 109 bytes in 539 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:31:11.133185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-408b4c93-c8f7-4203-9c85-88453e70b747 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Calling method '.version_select at 0x7fb8575aa940>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:11.389824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-408b4c93-c8f7-4203-9c85-88453e70b747 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] HTTP exception thrown: Volume e90351ee-838d-4fe1-b8bc-05016db60ae3 could not be found. Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-408b4c93-c8f7-4203-9c85-88453e70b747 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Request method failure captured: Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/os-volumes/e90351ee-838d-4fe1-b8bc-05016db60ae3 HTTP/1.1 Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxbgWr45d_jNna7kW1GEvbsy-x5LjSetI16NmkDCO-7XG7eT78jymW0q1TtJsCJpS7UHZHFn9LyYcV_4aZeUcYMeND8Fi503mE1kBnsiEvv2lOvtMO95rS7V4YEH4S4MX2Sg-FtUnHVc3F6zj27auUo7qq_ettHCp6-97KStCC6T9U Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:31:11.392038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_7864c80b2a9b40aeb18e046fe866cf2b", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/7864c80b2a9b40aeb18e046fe866cf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/7864c80b2a9b40aeb18e046fe866cf2b"}]}] Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 7864c80b2a9b40aeb18e046fe866cf2b Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-VolumesNegativeTest-517797689 Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 628da841395b4b7e9b3d238c04fe7cee Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-VolumesNegativeTest-517797689-project Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Volume e90351ee-838d-4fe1-b8bc-05016db60ae3 could not be found. Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'e90351ee-838d-4fe1-b8bc-05016db60ae3'} Sep 01 17:31:11.437740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e90351ee-838d-4fe1-b8bc-05016db60ae3 could not be found. (HTTP 404) (Request-ID: req-a0467074-f6d5-460b-b1a9-b39ece48cd7a) Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:11.440293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:31:11.443619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e90351ee-838d-4fe1-b8bc-05016db60ae3 could not be found. Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 17:31:11.448652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e90351ee-838d-4fe1-b8bc-05016db60ae3 could not be found. Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e90351ee-838d-4fe1-b8bc-05016db60ae3 could not be found. Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-408b4c93-c8f7-4203-9c85-88453e70b747 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] Returning 404 to user: Volume e90351ee-838d-4fe1-b8bc-05016db60ae3 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-408b4c93-c8f7-4203-9c85-88453e70b747 tempest-VolumesNegativeTest-517797689 tempest-VolumesNegativeTest-517797689-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/e90351ee-838d-4fe1-b8bc-05016db60ae3" status: 404 len: 109 microversion: 2.1 time: 0.265816 Sep 01 17:31:11.454117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 8/8] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:11 2022] GET /compute/v2.1/os-volumes/e90351ee-838d-4fe1-b8bc-05016db60ae3 => generated 109 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:31:11.663219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6d643b10-eef9-4014-9205-4d7aa4b929df tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.371565 Sep 01 17:31:11.677719 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 1/9] 10.222.0.102 () {60 vars in 1160 bytes} [Thu Sep 1 17:31:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3388 msecs (HTTP/1.1 200) 10 headers in 449 bytes (2 switches on core 0) Sep 01 17:31:11.682107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ac17b616-26c3-460d-b27c-3c702f4ef9b6 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8577549d0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:11.761333 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ac17b616-26c3-460d-b27c-3c702f4ef9b6 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49" status: 200 len: 345 microversion: 2.1 time: 0.084868 Sep 01 17:31:11.762228 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 9/10] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:11 2022] GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:12.348071 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-10315a36-19c5-4bfc-9a04-fdb6dfd6125a tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb8576430d0>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:12.412740 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-10315a36-19c5-4bfc-9a04-fdb6dfd6125a tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/c441a9ab-fd31-4943-9f42-1ebcc724e892" status: 200 len: 351 microversion: 2.1 time: 0.069401 Sep 01 17:31:12.422689 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 2/11] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:12 2022] GET /compute/v2.1/os-volumes/c441a9ab-fd31-4943-9f42-1ebcc724e892 => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:12.786722 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e5f9a7df-e8f9-4808-8837-24cb5d1a579f tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8575aae50>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:13.050552 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e5f9a7df-e8f9-4808-8837-24cb5d1a579f tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49" status: 200 len: 346 microversion: 2.1 time: 0.277825 Sep 01 17:31:13.051968 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 10/12] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:12 2022] GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 => generated 346 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:31:13.066872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6c7de668-5630-43d5-a8f0-07cd7e5e75e4 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Action: 'create', calling method: .version_select at 0x7fb857643790>, body: {"snapshot": {"volume_id": "2c8b40d9-8a5f-4c5d-b214-e54bea470d49", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-540298463"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:13.565877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6c7de668-5630-43d5-a8f0-07cd7e5e75e4 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.502945 Sep 01 17:31:13.580067 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 3/13] 10.222.0.102 () {60 vars in 1167 bytes} [Thu Sep 1 17:31:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:13.582626 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9039a908-0ee3-45b2-af38-e9347b7539f1 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb85754b280>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:13.840788 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9039a908-0ee3-45b2-af38-e9347b7539f1 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.263911 Sep 01 17:31:13.841687 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 11/14] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:13 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:13.862613 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a94fd8c6-765c-4e1a-a99f-50dae4930bd5 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8575c9820>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:14.027926 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a94fd8c6-765c-4e1a-a99f-50dae4930bd5 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.177682 Sep 01 17:31:14.028490 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 4/15] 10.222.0.102 () {58 vars in 1145 bytes} [Thu Sep 1 17:31:13 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:14.051485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2ee02cfc-522c-47de-95f1-e307ab83cdb5 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb85754b670>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:14.112996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1b47b5b9-62aa-47a6-81d5-85747059895e tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb857643280>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:14.169535 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2ee02cfc-522c-47de-95f1-e307ab83cdb5 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.124451 Sep 01 17:31:14.170367 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 12/16] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:14 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:14.307883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1b47b5b9-62aa-47a6-81d5-85747059895e tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/34c59922-9499-40fa-b012-f9d474a443a5" status: 200 len: 351 microversion: 2.1 time: 0.199931 Sep 01 17:31:14.309035 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 5/17] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:14 2022] GET /compute/v2.1/os-volumes/34c59922-9499-40fa-b012-f9d474a443a5 => generated 351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:15.182689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6dd245fe-b66d-4822-9ca1-e0501c3eae87 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb85754b280>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:15.294631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6dd245fe-b66d-4822-9ca1-e0501c3eae87 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.115813 Sep 01 17:31:15.298120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 13/18] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:15 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:16.312362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-451b6ee7-99d7-4094-8c63-8fbca71022b4 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8575c9700>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:16.365722 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-451b6ee7-99d7-4094-8c63-8fbca71022b4 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.059083 Sep 01 17:31:16.371348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 6/19] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:16 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:17.380989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-85b98506-2919-4e35-8278-5ccea8ca948a tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8575aa5e0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:17.440143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-85b98506-2919-4e35-8278-5ccea8ca948a tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.063577 Sep 01 17:31:17.440937 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 14/20] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:17 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:18.455567 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-471ad417-895b-4df8-bd7e-3eec122cfd6f tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8575c9e50>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:18.526173 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-471ad417-895b-4df8-bd7e-3eec122cfd6f tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.077445 Sep 01 17:31:18.526890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 7/21] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:18 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:19.217219 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-750c5817-2b9b-4296-86e8-359be9c5696c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'create', calling method: .version_select at 0x7fb8575aa790>, body: {"keypair": {"name": "tempest-keypair-553625139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD45VpPdJ2CBkSllPHUC6fa3ngMoWrilyg7HgDrXPwAHpsHxJQl5FvWZDfSi6sirkP8e1ic11eyrdk7WyOEloyv/FE1qUa8vAVBIA3H/G9dvsEFsYQ5JGDUxZfpfXQDqWg=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:19.330989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-750c5817-2b9b-4296-86e8-359be9c5696c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Getting quotas for project 97796d8be4794e89a89965af17bb3fa9. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:31:19.338635 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-750c5817-2b9b-4296-86e8-359be9c5696c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Getting quotas for user 26bf17f1fb8948008fed82f4ba33bf66 and project 97796d8be4794e89a89965af17bb3fa9. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:31:19.396005 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-750c5817-2b9b-4296-86e8-359be9c5696c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.677677 Sep 01 17:31:19.397190 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 15/22] 10.222.0.102 () {62 vars in 1205 bytes} [Thu Sep 1 17:31:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 680 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 17:31:19.540338 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-98e462d8-236c-4a4d-bbae-693318742a50 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb85751fc10>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:19.599001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-98e462d8-236c-4a4d-bbae-693318742a50 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.064026 Sep 01 17:31:19.599647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 16/23] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:19 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:31:19.877057 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-390096331", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:20.094070 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] validate_networks() for [('5ad650f3-6ca0-408f-a5ce-4fc2e1ab918f', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:31:20.613588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a9f2d6fa-ed51-4c1d-b7ba-4d83f43a9f2b tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8574d5310>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:20.694457 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a9f2d6fa-ed51-4c1d-b7ba-4d83f43a9f2b tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.085260 Sep 01 17:31:20.695311 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 17/24] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:20 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:21.711646 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8ce34de6-c49f-4e97-ae0b-cc0a8949ecc0 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8574d59d0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:21.783271 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8ce34de6-c49f-4e97-ae0b-cc0a8949ecc0 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.077166 Sep 01 17:31:21.783938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 18/25] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:21 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:31:22.556746 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:31:22.557178 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:31:22.557644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:31:22.558046 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:31:22.558448 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:31:22.587010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:22.587651 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:22.588244 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:22.589121 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:22.589733 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:22.592399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:22.687990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Getting quotas for project 79c90aaff0a44b278807167fdbd38e48. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:31:22.703085 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Getting quotas for user d364c74791fc4cd4af6773433a7a13cc and project 79c90aaff0a44b278807167fdbd38e48. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:31:22.748055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:31:22.751995 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:31:22.798912 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b7f4f880-4cf0-47a8-adb2-5876f89255f4 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb85751fdc0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:22.872717 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b7f4f880-4cf0-47a8-adb2-5876f89255f4 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 287 microversion: 2.1 time: 0.077381 Sep 01 17:31:22.873294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 19/26] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:22 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:22.885441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-68747189-132d-4807-b6de-68158c6a3eda tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8574d5dc0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:22.918269 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-13f738b8-e129-458d-a61b-cdf6f2242be9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.467772 Sep 01 17:31:22.919250 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 8/27] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:31:19 2022] POST /compute/v2.1/servers => generated 385 bytes in 3469 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:31:22.932179 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8d7f4d4b-9743-4cdd-a0c6-771aff927710 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:22.932670 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8d7f4d4b-9743-4cdd-a0c6-771aff927710 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:23.016715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-68747189-132d-4807-b6de-68158c6a3eda tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "DELETE /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 202 len: 0 microversion: 2.1 time: 0.135009 Sep 01 17:31:23.017647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 20/28] 10.222.0.102 () {58 vars in 1259 bytes} [Thu Sep 1 17:31:22 2022] DELETE /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:31:23.026315 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-27d7b5ad-84e0-4f66-a7bc-0a351b0cf89f tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8574d5820>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:23.144542 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-27d7b5ad-84e0-4f66-a7bc-0a351b0cf89f tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.122216 Sep 01 17:31:23.145110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 21/29] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:23 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:23.382754 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8d7f4d4b-9743-4cdd-a0c6-771aff927710 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:23.410299 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8d7f4d4b-9743-4cdd-a0c6-771aff927710 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1225 microversion: 2.1 time: 0.482347 Sep 01 17:31:23.414385 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 9/30] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:22 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1225 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:23.667457 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-802557604", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c1f0e47-9c23-4408-9f07-ba59e0499662"}], "security_groups": [{"name": "tempest-securitygroup--659738935"}], "key_name": "tempest-keypair-553625139", "user_data": "}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:23.835009 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1197705793", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:24.025100 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] validate_networks() for [('5ad650f3-6ca0-408f-a5ce-4fc2e1ab918f', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:31:24.148021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] validate_networks() for [('0c1f0e47-9c23-4408-9f07-ba59e0499662', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:31:25.344008 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:31:25.344527 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:31:25.344885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:31:25.345284 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:31:25.345858 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:31:25.366982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:25.367591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:25.369548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:25.370368 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:25.370858 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:25.372562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:25.393552 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Getting quotas for project 79c90aaff0a44b278807167fdbd38e48. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:31:25.399158 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Getting quotas for user d364c74791fc4cd4af6773433a7a13cc and project 79c90aaff0a44b278807167fdbd38e48. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:31:25.412394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:31:25.414830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:31:25.470950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4d8b1db7-d4a9-43ea-8b16-b8ca35349875 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.641373 Sep 01 17:31:25.472375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 10/31] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:31:23 2022] POST /compute/v2.1/servers => generated 385 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:31:25.477019 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9c0df426-d488-4b2f-a6c6-6388e9908f3f tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb856d045e0>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:25.531746 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9c0df426-d488-4b2f-a6c6-6388e9908f3f tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/b7e855ea-f39b-4885-a83f-2dc920ea96ef" status: 200 len: 349 microversion: 2.1 time: 0.058142 Sep 01 17:31:25.532479 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 11/32] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:25 2022] GET /compute/v2.1/os-volumes/b7e855ea-f39b-4885-a83f-2dc920ea96ef => generated 349 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:25.537341 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b004e9c9-e40a-40ed-9719-f6d33831bc6d tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb856ce4d30>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:25.572280 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b004e9c9-e40a-40ed-9719-f6d33831bc6d tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.038618 Sep 01 17:31:25.574559 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 12/33] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:25 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:26.073546 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:31:26.074529 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:31:26.075332 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:31:26.076430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:31:26.077192 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:31:26.100543 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:26.101228 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:26.101709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:26.102445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:26.102893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:26.105938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:26.162469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Getting quotas for project 97796d8be4794e89a89965af17bb3fa9. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:31:26.172666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Getting quotas for user 26bf17f1fb8948008fed82f4ba33bf66 and project 97796d8be4794e89a89965af17bb3fa9. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:31:26.180774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-998429782", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "networks": [{"uuid": "de110b7b-6542-41ff-9467-a5908f49a5be"}]}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:26.201429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:31:26.206739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:31:26.308077 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] validate_networks() for [('de110b7b-6542-41ff-9467-a5908f49a5be', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:31:26.395633 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0241c7ab-2fe7-4fa7-b741-90a02d4014f5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 2.734442 Sep 01 17:31:26.397027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 22/34] 10.222.0.102 () {62 vars in 1193 bytes} [Thu Sep 1 17:31:23 2022] POST /compute/v2.1/servers => generated 403 bytes in 2737 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 01 17:31:26.413291 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c18a761c-3a85-4b09-9abb-032bbf104ea2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:26.414241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c18a761c-3a85-4b09-9abb-032bbf104ea2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:26.564874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c18a761c-3a85-4b09-9abb-032bbf104ea2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:26.586002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c18a761c-3a85-4b09-9abb-032bbf104ea2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1226 microversion: 2.1 time: 0.181056 Sep 01 17:31:26.587107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 23/35] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:26 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1226 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:26.593002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7ddc6b10-845b-40bc-99fc-98e551f2b25e tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb856c2a4c0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:26.702744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7ddc6b10-845b-40bc-99fc-98e551f2b25e tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.114346 Sep 01 17:31:26.703694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 24/36] 10.222.0.102 () {58 vars in 1139 bytes} [Thu Sep 1 17:31:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:26.711318 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fa3efb8f-1fdb-43a3-866e-98a1c2de373b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:26.713101 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-fa3efb8f-1fdb-43a3-866e-98a1c2de373b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:26.832248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fa3efb8f-1fdb-43a3-866e-98a1c2de373b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:26.862306 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fa3efb8f-1fdb-43a3-866e-98a1c2de373b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:26.864307 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fa3efb8f-1fdb-43a3-866e-98a1c2de373b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:26.867902 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fa3efb8f-1fdb-43a3-866e-98a1c2de373b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1284 microversion: 2.20 time: 0.162896 Sep 01 17:31:26.868978 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 25/37] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:26 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:26.875500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f8cb2b6d-6f12-414d-a07b-bd8e3fcf8c76 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb856c35670>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:26.964765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f8cb2b6d-6f12-414d-a07b-bd8e3fcf8c76 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.093123 Sep 01 17:31:26.965785 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 26/38] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:26 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:26.972088 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b257bef0-ee37-4a68-9c6e-8495e6699a80 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb856c07a60>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.176649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b257bef0-ee37-4a68-9c6e-8495e6699a80 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.209475 Sep 01 17:31:27.177235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 27/39] 10.222.0.102 () {58 vars in 1154 bytes} [Thu Sep 1 17:31:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:27.194399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a8007efc-1dc6-4aec-bed6-fe86c92eee04 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb856c39ee0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.386959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a8007efc-1dc6-4aec-bed6-fe86c92eee04 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.196218 Sep 01 17:31:27.387999 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 28/40] 10.222.0.102 () {58 vars in 1139 bytes} [Thu Sep 1 17:31:27 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:31:27.401567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2a4d0c40-228b-47c7-ac3d-ff45f7197490 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb85746d940>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.484690 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:31:27.485206 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:31:27.485804 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:31:27.487745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:31:27.488215 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:31:27.513886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:27.517589 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:27.519841 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:27.533700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:27.533700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:27.533700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:27.560525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Getting quotas for project 1f232c720f5a4108a46e79700be67099. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:31:27.565995 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Getting quotas for user 19a53d1e1a84408ea1dc2aba24bd8299 and project 1f232c720f5a4108a46e79700be67099. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:31:27.588379 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:31:27.591004 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:31:27.647880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-bae4de80-3100-4f2e-8717-dc71b7787bdc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.071998 Sep 01 17:31:27.649013 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 13/41] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:31:25 2022] POST /compute/v2.1/servers => generated 382 bytes in 2074 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:31:27.655166 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.656432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:27.664412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:27.665154 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:27.665962 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:27.667014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:27.667661 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:27.668337 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:27.706762 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2a4d0c40-228b-47c7-ac3d-ff45f7197490 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.309306 Sep 01 17:31:27.707351 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 29/42] 10.222.0.102 () {58 vars in 1172 bytes} [Thu Sep 1 17:31:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:27.722386 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e9847049-efa8-4ce6-93b1-650894022c78 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.724062 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e9847049-efa8-4ce6-93b1-650894022c78 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:27.844126 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e9847049-efa8-4ce6-93b1-650894022c78 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:27.871179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e9847049-efa8-4ce6-93b1-650894022c78 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1218 microversion: 2.1 time: 0.162670 Sep 01 17:31:27.871651 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 30/43] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:27 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:27.894579 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-208d646a-9046-462c-bcb6-f8fca68a3155 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb856c35820>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:27.995186 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:28.049052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1de7586c-e5e4-45eb-ae44-9fa531295cb1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1222 microversion: 2.1 time: 0.396825 Sep 01 17:31:28.050321 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 14/44] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:27 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1222 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:28.066533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:28.071421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:28.096212 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:28.096979 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:28.097799 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:28.100459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:28.103154 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:28.106668 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:28.124268 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-208d646a-9046-462c-bcb6-f8fca68a3155 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.235245 Sep 01 17:31:28.125112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 31/45] 10.222.0.102 () {58 vars in 1175 bytes} [Thu Sep 1 17:31:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:28.129835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1a3bb055-fcd6-4c88-8802-de624e903e7f tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb85746df70>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:28.237958 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1a3bb055-fcd6-4c88-8802-de624e903e7f tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 200 len: 286 microversion: 2.1 time: 0.111518 Sep 01 17:31:28.239501 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 32/46] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:28 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:28.244909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-18b22d5b-463a-4a21-b2ac-4b0c73c98eba tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb856c39310>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:28.262309 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:28.280718 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:28.284819 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:28.287519 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-41225157-efce-4a15-a96f-f6aa2648d4e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1288 microversion: 2.20 time: 0.234682 Sep 01 17:31:28.288989 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 15/47] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:28 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1288 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:28.443606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-18b22d5b-463a-4a21-b2ac-4b0c73c98eba tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.202733 Sep 01 17:31:28.444568 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 33/48] 10.222.0.102 () {58 vars in 1160 bytes} [Thu Sep 1 17:31:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:28.465665 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-006bd93a-3c2f-4f3f-8e4a-5df4b961e9d2 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb856c0f280>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:28.687952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-006bd93a-3c2f-4f3f-8e4a-5df4b961e9d2 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.232441 Sep 01 17:31:28.689048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 16/49] 10.222.0.102 () {58 vars in 1193 bytes} [Thu Sep 1 17:31:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:28.703158 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ea3b9dc8-eca8-4824-9b92-7ee8cbcc3741 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] Calling method '.version_select at 0x7fb856c435e0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:28.896438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:28.897457 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:28.906822 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:28.907632 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:28.908233 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:28.910035 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:28.912218 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:28.913025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:28.956585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ea3b9dc8-eca8-4824-9b92-7ee8cbcc3741 tempest-VolumesTestJSON-515985212 tempest-VolumesTestJSON-515985212-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.258209 Sep 01 17:31:28.957428 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 34/50] 10.222.0.102 () {58 vars in 1160 bytes} [Thu Sep 1 17:31:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:29.037772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:29.048881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2e09cd9e-f766-40e1-8bd2-437417141f62 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1222 microversion: 2.1 time: 0.160519 Sep 01 17:31:29.049917 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 17/51] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:28 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:29.072267 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:29.073472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:29.081094 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:29.081713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:29.082227 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:29.084756 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:29.086008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:29.086663 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:29.259939 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f5dc099b-ebee-4262-96a8-a588c9e762da tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb856c1a820>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:29.382094 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:29.397792 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8d923931-113c-467c-b060-49f1f04b7666 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1278 microversion: 2.1 time: 0.328655 Sep 01 17:31:29.411845 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 35/52] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:29 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1278 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:29.416889 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:29.417726 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:29.426139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:29.426947 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:29.433257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:29.434676 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:29.435515 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:29.436982 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:29.458201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-f5dc099b-ebee-4262-96a8-a588c9e762da tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] HTTP exception thrown: Snapshot 21b7ea40-df90-4ab6-93c4-d948301c0d11 could not be found. Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f5dc099b-ebee-4262-96a8-a588c9e762da tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Request method failure captured: Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 HTTP/1.1 Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxc-sGEJivqJG5ABGtI6JntvYtnaXNvLf6ktsE-LSIoI-ElvLcgxN416QAlySx5brC4Qtkew4pDjCP5ZEAAJcD9TW1gcvUq7cuq1ERUaIb6pkaNFFNq6TPYvbed6toU-NGXHxLFhkBRAEY-wvtE3Fi9jmO-Uc5hgpbciKiupltZUBQ Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 577f304fbcfb4e01ab66bd4a62d30d8e Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:31:29.465422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_577f304fbcfb4e01ab66bd4a62d30d8e", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/577f304fbcfb4e01ab66bd4a62d30d8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/577f304fbcfb4e01ab66bd4a62d30d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/577f304fbcfb4e01ab66bd4a62d30d8e"}]}] Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 577f304fbcfb4e01ab66bd4a62d30d8e Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-VolumesSnapshotsTestJSON-473585187-project Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: a54660f778c24611ae52c1628d17fd78 Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-VolumesSnapshotsTestJSON-473585187-project Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Snapshot 21b7ea40-df90-4ab6-93c4-d948301c0d11 could not be found. Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '21b7ea40-df90-4ab6-93c4-d948301c0d11'} Sep 01 17:31:29.466566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 21b7ea40-df90-4ab6-93c4-d948301c0d11 could not be found. (HTTP 404) (Request-ID: req-298e78dc-72c4-4130-8f60-ed94aad4fb0f) Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:29.467293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:31:29.468200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 21b7ea40-df90-4ab6-93c4-d948301c0d11 could not be found. Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 17:31:29.469120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 21b7ea40-df90-4ab6-93c4-d948301c0d11 could not be found. Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 21b7ea40-df90-4ab6-93c4-d948301c0d11 could not be found. Sep 01 17:31:29.470096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:29.473232 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f5dc099b-ebee-4262-96a8-a588c9e762da tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Returning 404 to user: Snapshot 21b7ea40-df90-4ab6-93c4-d948301c0d11 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:29.474415 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f5dc099b-ebee-4262-96a8-a588c9e762da tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11" status: 404 len: 111 microversion: 2.1 time: 0.219466 Sep 01 17:31:29.476044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 18/53] 10.222.0.102 () {58 vars in 1256 bytes} [Thu Sep 1 17:31:29 2022] GET /compute/v2.1/os-snapshots/21b7ea40-df90-4ab6-93c4-d948301c0d11 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:31:29.492899 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0e47d12c-3019-407e-ad47-47e5ff51868d tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb8576435e0>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:29.546020 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:29.556104 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:29.559824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:29.563507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-82aee378-5ee0-44a0-82dc-645fccec34a2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1336 microversion: 2.20 time: 0.150539 Sep 01 17:31:29.565039 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 36/54] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:29 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1336 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:29.627060 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0e47d12c-3019-407e-ad47-47e5ff51868d tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49" status: 202 len: 0 microversion: 2.1 time: 0.144356 Sep 01 17:31:29.627667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 19/55] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:31:29 2022] DELETE /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:31:29.637109 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c3efa03e-69b7-4cb1-8c40-e32c20b48d31 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb856b5bf70>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:29.737515 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c3efa03e-69b7-4cb1-8c40-e32c20b48d31 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49" status: 200 len: 345 microversion: 2.1 time: 0.104888 Sep 01 17:31:29.738332 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 37/56] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:29 2022] GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:30.074933 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:30.075557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:30.085460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:30.086574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:30.087181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:30.088048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:30.088513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:30.088941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:30.223161 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:30.246056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b9477a23-ba25-401c-a2c7-78a3eb69ba3b tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1270 microversion: 2.1 time: 0.174793 Sep 01 17:31:30.247040 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 20/57] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:30 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:30.418741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:30.419216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:30.433746 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:30.438828 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:30.439337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:30.444897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:30.446872 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:30.448007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:30.592810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:30.593881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:30.606012 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:30.611847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:30.617113 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:30.617983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:30.618466 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:30.618903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:30.818176 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:30.831344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-08392bff-e8ae-4473-8794-6b87ce47f175 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1286 microversion: 2.1 time: 0.413924 Sep 01 17:31:30.832608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 38/58] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:30 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1286 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:30.863436 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-70d3d5b2-1664-4fe2-8473-80a5d9b9d3bb tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb856ba8c10>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:30.897179 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:30.921809 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:30.923416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:30.924576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-27f58fab-b946-45c0-8bc4-d33c79981541 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1344 microversion: 2.20 time: 0.338567 Sep 01 17:31:30.925137 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 21/59] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:30 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1344 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:30.985269 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-70d3d5b2-1664-4fe2-8473-80a5d9b9d3bb tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49" status: 200 len: 345 microversion: 2.1 time: 0.150245 Sep 01 17:31:30.985930 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 39/60] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:30 2022] GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 => generated 345 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:31.267987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:31.269545 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:31.276906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:31.277691 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:31.278505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:31.279677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:31.280322 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:31.281155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:31.351426 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:31.362432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ca9d1fab-5ac0-4a6c-babb-4fa4294b8e10 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1270 microversion: 2.1 time: 0.098733 Sep 01 17:31:31.363436 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 22/61] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:31 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:31.857693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:31.858380 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:31.875118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:31.878051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:31.880681 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:31.881523 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:31.884736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:31.886681 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:31.950757 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:31.951910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:31.971990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:31.972519 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:31.972965 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:31.976506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:31.979698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:31.982853 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:32.556899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:32.569014 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d3ff3612-1269-49b9-b838-1f869ec6f8ad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.716490 Sep 01 17:31:32.571584 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 40/62] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:31 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:32.582643 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fa76f1f5-a852-4a53-978a-4dd403e9621a tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb856bb60d0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:32.637800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-fa76f1f5-a852-4a53-978a-4dd403e9621a tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] HTTP exception thrown: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fa76f1f5-a852-4a53-978a-4dd403e9621a tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Request method failure captured: Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 HTTP/1.1 Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxc-sGEJivqJG5ABGtI6JntvYtnaXNvLf6ktsE-LSIoI-ElvLcgxN416QAlySx5brC4Qtkew4pDjCP5ZEAAJcD9TW1gcvUq7cuq1ERUaIb6pkaNFFNq6TPYvbed6toU-NGXHxLFhkBRAEY-wvtE3Fi9jmO-Uc5hgpbciKiupltZUBQ Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 577f304fbcfb4e01ab66bd4a62d30d8e Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:31:32.642187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_577f304fbcfb4e01ab66bd4a62d30d8e", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/577f304fbcfb4e01ab66bd4a62d30d8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/577f304fbcfb4e01ab66bd4a62d30d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/577f304fbcfb4e01ab66bd4a62d30d8e"}]}] Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 577f304fbcfb4e01ab66bd4a62d30d8e Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-VolumesSnapshotsTestJSON-473585187-project Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: a54660f778c24611ae52c1628d17fd78 Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-VolumesSnapshotsTestJSON-473585187-project Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '2c8b40d9-8a5f-4c5d-b214-e54bea470d49'} Sep 01 17:31:32.643548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. (HTTP 404) (Request-ID: req-3fbccd37-d247-4b01-8c5c-a89e9a9919a9) Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:32.644372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:31:32.645587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 17:31:32.646700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fa76f1f5-a852-4a53-978a-4dd403e9621a tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Returning 404 to user: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:32.647868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fa76f1f5-a852-4a53-978a-4dd403e9621a tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49" status: 404 len: 109 microversion: 2.1 time: 0.070200 Sep 01 17:31:32.654837 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 41/63] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:32 2022] GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:31:32.666052 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:32.666971 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:32.668984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:32.678160 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:32.678714 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:32.679525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:32.680486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:32.681486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:32.682396 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:32.704169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:32.711856 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:32.713159 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ea56ab5e-f3db-450c-bc2c-697588c6558f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1342 microversion: 2.20 time: 0.766862 Sep 01 17:31:32.733343 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 23/64] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:31 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1342 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:32.738513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6848c959-cac2-4a79-aa56-26a437a7a8c3 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb856b503a0>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:32.789108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-6848c959-cac2-4a79-aa56-26a437a7a8c3 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] HTTP exception thrown: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6848c959-cac2-4a79-aa56-26a437a7a8c3 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Request method failure captured: Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: DELETE /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 HTTP/1.1 Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxc-sGEJivqJG5ABGtI6JntvYtnaXNvLf6ktsE-LSIoI-ElvLcgxN416QAlySx5brC4Qtkew4pDjCP5ZEAAJcD9TW1gcvUq7cuq1ERUaIb6pkaNFFNq6TPYvbed6toU-NGXHxLFhkBRAEY-wvtE3Fi9jmO-Uc5hgpbciKiupltZUBQ Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 577f304fbcfb4e01ab66bd4a62d30d8e Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:31:32.791879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_577f304fbcfb4e01ab66bd4a62d30d8e", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/577f304fbcfb4e01ab66bd4a62d30d8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/577f304fbcfb4e01ab66bd4a62d30d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/577f304fbcfb4e01ab66bd4a62d30d8e"}]}] Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 577f304fbcfb4e01ab66bd4a62d30d8e Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-VolumesSnapshotsTestJSON-473585187-project Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: a54660f778c24611ae52c1628d17fd78 Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-VolumesSnapshotsTestJSON-473585187-project Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '2c8b40d9-8a5f-4c5d-b214-e54bea470d49'} Sep 01 17:31:32.793024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. (HTTP 404) (Request-ID: req-88b7f1d0-aaa8-4420-a67b-c09420f2ed3f) Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:32.793699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 17:31:32.795656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 17:31:32.796785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6848c959-cac2-4a79-aa56-26a437a7a8c3 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Returning 404 to user: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:32.799396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6848c959-cac2-4a79-aa56-26a437a7a8c3 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49" status: 404 len: 109 microversion: 2.1 time: 0.058985 Sep 01 17:31:32.801007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 24/65] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:31:32 2022] DELETE /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:31:32.817103 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e4f37d70-1f75-4363-8ce5-4319d0fa4756 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Calling method '.version_select at 0x7fb856c1a790>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:32.887086 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-e4f37d70-1f75-4363-8ce5-4319d0fa4756 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] HTTP exception thrown: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e4f37d70-1f75-4363-8ce5-4319d0fa4756 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Request method failure captured: Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 HTTP/1.1 Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxc-sGEJivqJG5ABGtI6JntvYtnaXNvLf6ktsE-LSIoI-ElvLcgxN416QAlySx5brC4Qtkew4pDjCP5ZEAAJcD9TW1gcvUq7cuq1ERUaIb6pkaNFFNq6TPYvbed6toU-NGXHxLFhkBRAEY-wvtE3Fi9jmO-Uc5hgpbciKiupltZUBQ Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 577f304fbcfb4e01ab66bd4a62d30d8e Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:31:32.890076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_577f304fbcfb4e01ab66bd4a62d30d8e", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/577f304fbcfb4e01ab66bd4a62d30d8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/577f304fbcfb4e01ab66bd4a62d30d8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/577f304fbcfb4e01ab66bd4a62d30d8e"}]}] Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 577f304fbcfb4e01ab66bd4a62d30d8e Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-473585187 Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-VolumesSnapshotsTestJSON-473585187-project Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: a54660f778c24611ae52c1628d17fd78 Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-VolumesSnapshotsTestJSON-473585187-project Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '2c8b40d9-8a5f-4c5d-b214-e54bea470d49'} Sep 01 17:31:32.891630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. (HTTP 404) (Request-ID: req-8e779137-3fc0-4b9d-bb1c-c606ffeb64bf) Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:32.892642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:31:32.905943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 17:31:32.907692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. Sep 01 17:31:32.908821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:31:32.913025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e4f37d70-1f75-4363-8ce5-4319d0fa4756 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] Returning 404 to user: Volume 2c8b40d9-8a5f-4c5d-b214-e54bea470d49 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:31:32.913025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e4f37d70-1f75-4363-8ce5-4319d0fa4756 tempest-VolumesSnapshotsTestJSON-473585187 tempest-VolumesSnapshotsTestJSON-473585187-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49" status: 404 len: 109 microversion: 2.1 time: 0.110561 Sep 01 17:31:32.913025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 25/66] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:31:32 2022] GET /compute/v2.1/os-volumes/2c8b40d9-8a5f-4c5d-b214-e54bea470d49 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:31:33.432850 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:33.443612 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fa77a9ce-eae5-440f-a426-8edf71b7e26e tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1276 microversion: 2.1 time: 0.786942 Sep 01 17:31:33.445619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 42/67] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:32 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1276 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:33.591565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:33.592597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:33.600585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:33.603460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:33.604093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:33.604820 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:33.605537 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:33.605705 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:33.742050 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:33.743035 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:33.756770 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:33.758465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:33.761299 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:33.763193 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:33.764414 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:33.772453 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:33.965686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:33.986857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:33.995541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:33.996973 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-babae49d-48a0-4422-a6cf-f1ab83459afc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1342 microversion: 2.20 time: 0.260314 Sep 01 17:31:34.002119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 43/68] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:33 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1342 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:34.375498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:34.390891 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cef78af5-f17e-4e08-aa11-258c8b86eb31 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.802546 Sep 01 17:31:34.396912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 26/69] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:33 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:34.469761 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:34.470511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:34.489715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:34.491252 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:34.497372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:34.507693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:34.509107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:34.511488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:35.022999 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:35.023615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:35.031497 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:35.031996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:35.032433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:35.033144 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:35.033625 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:35.034047 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:35.167822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:35.186565 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3e0986a1-37dd-4efd-ba73-1f1c223a87b2 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.724817 Sep 01 17:31:35.187518 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 44/70] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:34 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:35.304070 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:35.328969 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:35.330657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:35.332594 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b55239ec-215f-495c-aec3-4f6143634662 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.312990 Sep 01 17:31:35.333172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 27/71] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:35 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:35.422119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:35.422825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:35.428926 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:35.431267 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:35.436706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:35.437373 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:35.437841 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:35.438273 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:35.662249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:35.674469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6f3c9684-2f4d-41ff-b3b7-0991726c2eca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.256101 Sep 01 17:31:35.675160 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 45/72] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:35 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:36.073533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-a6be9ea4-f80e-49a1-b5b9-1d183f1d399b req-c732b5ef-ffd1-4648-bfa7-1afefca4217b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231831c1-c79e-41c4-876b-bc6e8be8aa3f", "tag": "41081b73-d685-4bd4-9f3d-2c08efd343a7"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:36.085547 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a6be9ea4-f80e-49a1-b5b9-1d183f1d399b req-c732b5ef-ffd1-4648-bfa7-1afefca4217b service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:36.086022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a6be9ea4-f80e-49a1-b5b9-1d183f1d399b req-c732b5ef-ffd1-4648-bfa7-1afefca4217b service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:36.086451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a6be9ea4-f80e-49a1-b5b9-1d183f1d399b req-c732b5ef-ffd1-4648-bfa7-1afefca4217b service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:36.105915 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-a6be9ea4-f80e-49a1-b5b9-1d183f1d399b req-c732b5ef-ffd1-4648-bfa7-1afefca4217b service nova] Creating event network-changed:41081b73-d685-4bd4-9f3d-2c08efd343a7 for instance 231831c1-c79e-41c4-876b-bc6e8be8aa3f on hv-cinder-85221 Sep 01 17:31:36.106487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a6be9ea4-f80e-49a1-b5b9-1d183f1d399b req-c732b5ef-ffd1-4648-bfa7-1afefca4217b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 17:31:36.106873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a6be9ea4-f80e-49a1-b5b9-1d183f1d399b req-c732b5ef-ffd1-4648-bfa7-1afefca4217b service nova] Acquired lock "compute-rpcapi-router" {{(pid=121745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 17:31:36.108434 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60aa7732-6bb7-4332-bca6-486aec05222e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:36.108903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60aa7732-6bb7-4332-bca6-486aec05222e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:36.109421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60aa7732-6bb7-4332-bca6-486aec05222e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:36.110148 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60aa7732-6bb7-4332-bca6-486aec05222e None None] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:36.110592 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60aa7732-6bb7-4332-bca6-486aec05222e None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:36.111002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60aa7732-6bb7-4332-bca6-486aec05222e None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:36.124199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.compute.rpcapi [None req-60aa7732-6bb7-4332-bca6-486aec05222e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 17:31:36.125090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60aa7732-6bb7-4332-bca6-486aec05222e None None] Releasing lock "compute-rpcapi-router" {{(pid=121745) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 17:31:36.141577 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-60aa7732-6bb7-4332-bca6-486aec05222e None None] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295397 Sep 01 17:31:36.142185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 28/73] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:36.209148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:36.210504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:36.213163 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:36.219420 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:36.219904 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:36.220332 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:36.221019 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:36.221748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:36.222180 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:36.357252 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:36.358512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:36.376673 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:36.382620 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:36.383326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:36.384397 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:36.384933 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:36.385930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:36.386732 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:36.393276 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-976195ad-f5ff-41c2-957b-dc083f74b697 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.189815 Sep 01 17:31:36.407960 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 46/74] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:36 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:36.558908 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:36.567752 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:36.569114 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:36.573873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-99bdc210-0dcd-4293-b0fc-699c36b91b14 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.218498 Sep 01 17:31:36.573873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 29/75] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:36 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:31:36.694553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:36.695268 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:36.701986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:36.702544 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:36.703042 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:36.703904 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:36.704909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:36.705366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:36.893163 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:36.902752 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fe91a016-9b4a-47da-a881-a1d44aa021c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.210974 Sep 01 17:31:36.903926 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 47/76] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:36 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:37.414739 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:37.415655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:37.424125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:37.424822 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:37.425404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:37.426345 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:37.426853 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:37.427296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:37.577150 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=20 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:37.604456 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:37.606011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:37.621976 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:37.624082 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:37.625165 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:37.629603 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:37.631476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:37.633044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:37.633653 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:37.643281 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e19eeae7-f6b4-4bc4-9ab7-094608973894 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.232123 Sep 01 17:31:37.644657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 30/77] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:37 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:37.870822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=16 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:37.896992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:37.907817 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:37.909372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:37.910463 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-18ed1da7-ea6f-44f1-8c44-a82aefbce1b0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.316011 Sep 01 17:31:37.911593 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 48/78] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:37 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:37.924935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:37.926000 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:37.934056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:37.934782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:37.935586 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:37.937218 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:37.938546 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:37.939045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:38.223616 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:38.231653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6c4a7e7c-d356-4a05-a393-b31b138f83db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.311626 Sep 01 17:31:38.232267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 31/79] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:37 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:38.688853 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:38.691239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:38.707650 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:38.708816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:38.724182 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:38.726373 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:38.728928 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:38.739911 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:38.936897 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:38.937750 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:38.948880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:38.950018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:38.950647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:38.952381 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:38.953247 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:38.957373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:39.121686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:39.135314 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-33836239-02c8-4b6e-b540-ae88ad9904fc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.465645 Sep 01 17:31:39.136109 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 49/80] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:38 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:39.239912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:39.250726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:39.252086 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:39.252682 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:39.253249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:39.254952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3c81b610-8503-48c6-b804-55f41f7c141e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.324701 Sep 01 17:31:39.269099 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:39.270845 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:39.272192 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 32/81] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:38 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:39.273159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:39.279817 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:39.280590 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:39.285431 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:39.657051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:39.677560 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-667c2f79-0a59-4462-bb04-60168a18fc77 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.417588 Sep 01 17:31:39.678471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 50/82] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:39 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:31:40.159216 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:40.161587 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:40.173476 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:40.174479 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:40.175398 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:40.178574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:40.181120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:40.181602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:40.284832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:40.286336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:40.297756 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:40.299927 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:40.301504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:40.303115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:40.304697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:40.307016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:40.428091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:40.437186 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fcff9fa3-17f2-43c1-9818-1c6508e3d78a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.284418 Sep 01 17:31:40.458015 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 33/83] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:40 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:40.599703 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:40.630369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:40.634716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:40.637179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-908945c5-59ae-4f40-92ca-08f550d13028 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.356300 Sep 01 17:31:40.643285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 51/84] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:40 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:40.700190 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:40.701942 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:40.711365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:40.713094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:40.716452 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:40.722472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:40.723970 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:40.724902 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:40.951595 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:40.956200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:40.967225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3e8c2846-1593-42d8-b870-380e0c836c88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.270087 Sep 01 17:31:40.968229 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 34/85] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:40 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:41.459778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:41.460720 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:41.473028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:41.474098 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:41.474747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:41.475579 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:41.479994 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:41.480745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:41.673121 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:41.673887 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:41.689002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:41.691364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:41.693187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:41.697984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:41.698739 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:41.700231 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:41.734907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:41.744712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-101f05f7-64f1-4fd2-a9bf-77e3517cfa6d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.289482 Sep 01 17:31:41.745690 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 52/86] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:41 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:41.973169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:41.983348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:41.992107 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:41.993365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-150141dc-4692-4901-9f9a-22b75b0c9eba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.325218 Sep 01 17:31:42.002571 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 35/87] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:41 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:42.006346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:42.007048 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:42.030397 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:42.030869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:42.031404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:42.032308 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:42.032764 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:42.033296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:42.366530 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:42.374933 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a1e478f3-12af-4163-a0ec-2b1d7a02dd9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.387814 Sep 01 17:31:42.377550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 53/88] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:41 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:42.772405 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:42.773110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:42.784571 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:42.786091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:42.786962 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:42.789619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:42.791368 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:42.793255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:43.028334 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:43.029776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:43.041936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:43.042430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:43.042875 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:43.043600 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:43.044099 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:43.045450 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:43.053505 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:43.152924 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:43.190358 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-86b68a73-da01-4036-9a2b-52714984af63 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.423467 Sep 01 17:31:43.191654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 36/89] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:42 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:43.377381 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:43.396260 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:43.398100 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:43.398676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:43.399311 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:43.403286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-51c4a8a9-2863-420b-8392-b3ae5d1c7391 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.387803 Sep 01 17:31:43.407249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 54/90] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:43 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:31:43.427387 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:43.427887 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:43.428329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:43.429051 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:43.429540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:43.429964 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:43.824655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:43.836916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c1857a64-5dd9-44e4-8146-705a92bb2311 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.443383 Sep 01 17:31:43.837948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 37/91] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:43 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:31:44.211936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:44.212524 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:44.227790 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:44.228268 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:44.229244 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:44.232712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:44.233361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:44.233947 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:44.437674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:44.440060 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:44.441076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:44.449972 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2eb269ec-1588-46f4-be67-62e1d154a903 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.241735 Sep 01 17:31:44.475828 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:44.476406 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 55/92] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:44 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:44.477290 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:44.477793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:44.480815 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:44.481279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:44.481724 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:44.813860 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:44.826552 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:44.829362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:44.830786 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b201ad61-abc9-4597-8417-5392cd1b61de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.401323 Sep 01 17:31:44.832225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 38/93] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:44 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:44.859174 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:44.859786 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:44.867385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:44.867891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:44.874053 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:44.874992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:44.875469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:44.875897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:45.137644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:45.150027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c5b5f12c-3939-4a25-9740-03b70e2c0b88 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.295260 Sep 01 17:31:45.164447 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 56/94] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:44 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:45.484074 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:45.484929 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:45.501347 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:45.502025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:45.508687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:45.509820 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:45.510532 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:45.511300 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:45.839504 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:45.851219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b6832660-21e5-4850-9dca-abecc4aafb33 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.371391 Sep 01 17:31:45.851951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 39/95] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:45 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:45.862014 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:45.863561 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:45.875894 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:45.879023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:45.879854 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:45.881356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:45.883399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:45.884017 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:46.096059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:46.108403 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:46.110401 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:46.111783 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-47d02b92-c466-48ba-b8eb-784897b78f3d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.253540 Sep 01 17:31:46.113023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 57/96] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:45 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:46.171686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:46.172296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:46.177382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=8 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:46.183557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:46.184041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:46.184644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:46.185711 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:46.186435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:46.187210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:46.356883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:46.365683 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f9030b15-e23f-42c5-8588-c18df0f26d1a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.197854 Sep 01 17:31:46.367445 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 40/97] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:46 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:46.877096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:46.878650 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:46.886870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:46.887640 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:46.888264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:46.889223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:46.890130 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:46.890559 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:47.053493 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:47.062374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b77073e5-aa4c-4074-992a-2b76a6624c72 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.190260 Sep 01 17:31:47.063248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 58/98] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:46 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:47.136302 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:47.137620 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:47.144620 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:47.145242 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:47.145892 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:47.146731 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:47.147995 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:47.148483 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:47.293031 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:47.303279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:47.305086 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:47.306477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8404b4b7-2638-4bcd-9e0e-fac4dad37961 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.174323 Sep 01 17:31:47.307122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 41/99] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:47 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:31:47.387229 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:47.388025 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:47.408488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:47.412880 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:47.414200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:47.415543 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:47.416190 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:47.416809 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:47.608675 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:47.626710 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5c977bed-9654-46e6-8793-a88a9882b8ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.243290 Sep 01 17:31:47.641935 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 59/100] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:47 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:48.087646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:48.091845 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:48.095991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:48.112089 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:48.112911 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:48.114380 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:48.115876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:48.116446 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:48.116925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:48.284402 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:48.304633 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b6fabe0e-389b-4dce-8996-f2ea2e0e95b7 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.221800 Sep 01 17:31:48.316696 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 42/101] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:48 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:48.331016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:48.332253 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:48.341754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:48.342426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:48.343215 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:48.344553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:48.345163 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:48.346722 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:48.523823 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:48.532684 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:48.535381 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:48.536481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a5dc42b8-784d-488c-bcfb-c4a131e84a66 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.210561 Sep 01 17:31:48.537016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 60/102] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:48 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:48.650869 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:48.652168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:48.659960 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:48.660516 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:48.661156 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:48.662497 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:48.663055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:48.663545 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:48.803334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:48.831846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ffe1360f-553b-451f-baf8-c2d4b7504ceb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.186026 Sep 01 17:31:48.832427 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 43/103] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:48 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:49.335791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:49.336393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:49.338480 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:49.343478 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:49.343954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:49.344571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:49.345516 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:49.346145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:49.348712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:49.560673 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:49.561327 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:49.574267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:49.575047 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:49.576448 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:49.578152 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:49.579923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:49.580538 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:50.218748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:50.232964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1fcfd39d-5f9d-4f11-9a75-0ca0ee5f76ee tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.901150 Sep 01 17:31:50.243122 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 61/104] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:49 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:50.248055 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:50.248661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:50.257852 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:50.258445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:50.258905 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:50.259604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:50.260126 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:50.263793 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:50.390716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:50.398849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:50.400258 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:50.401383 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-78acc9e5-4505-4037-b9e4-9c8d2330d25c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.845505 Sep 01 17:31:50.414059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 44/105] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:49 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:31:50.748166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:50.769963 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-50796aa7-dc92-4cf1-9cf7-8614e542ddb4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.525469 Sep 01 17:31:50.775492 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 62/106] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:50 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:50.966658 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-5b231f94-dca1-449c-84e0-56f067637516 req-e99454a3-1cc5-4312-acad-00a129a25a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f82500-1b55-4e1c-985a-c30b9ed0c0e9", "tag": "08adab5a-ac54-4387-b5b3-a054ac79c9fc"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:50.986633 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-5b231f94-dca1-449c-84e0-56f067637516 req-e99454a3-1cc5-4312-acad-00a129a25a35 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:50.987667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-5b231f94-dca1-449c-84e0-56f067637516 req-e99454a3-1cc5-4312-acad-00a129a25a35 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:50.988753 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-5b231f94-dca1-449c-84e0-56f067637516 req-e99454a3-1cc5-4312-acad-00a129a25a35 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:51.013516 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-5b231f94-dca1-449c-84e0-56f067637516 req-e99454a3-1cc5-4312-acad-00a129a25a35 service nova] Creating event network-changed:08adab5a-ac54-4387-b5b3-a054ac79c9fc for instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 on hv-cinder-85221 Sep 01 17:31:51.022526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-5b231f94-dca1-449c-84e0-56f067637516 req-e99454a3-1cc5-4312-acad-00a129a25a35 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060062 Sep 01 17:31:51.023472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 45/107] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:51.264944 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:51.265738 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:51.276690 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:51.277480 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:51.278131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:51.279576 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:51.285260 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:51.285984 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:51.438888 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:51.439477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:51.462462 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:51.463141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:51.464019 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:51.464743 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:51.465202 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:51.467157 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:51.959983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:51.975054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5a6486f7-0cf4-42cb-a979-dec0db8a3543 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.711025 Sep 01 17:31:51.977806 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 63/108] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:51 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:51.988884 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:51.989525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:52.004397 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:52.006565 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:52.007165 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:52.008263 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:52.010411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:52.011689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:52.490006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:52.501490 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:52.512116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:52.514178 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ffb384fc-517e-445a-bbe8-9fd298dbc72a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 1.080188 Sep 01 17:31:52.530855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 46/109] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:51 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:31:52.678610 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:52.690048 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c56f30a0-bcfd-4a3d-88ef-e92fee6f783b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.710873 Sep 01 17:31:52.690655 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 64/110] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:51 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:52.999344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:53.000928 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:53.012299 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:53.014289 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:53.015628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:53.016456 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:53.018498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:53.019998 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:53.140919 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-c8c6193c-280f-4a4f-975d-31e02c629d7f req-9b54af88-18ba-4fdc-ba47-01d94b5093e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc18513-a02d-498d-9607-46c4bbd2306a", "tag": "628ce1e2-6bc7-43e7-a353-8dbcabd8373f"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:53.165320 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c8c6193c-280f-4a4f-975d-31e02c629d7f req-9b54af88-18ba-4fdc-ba47-01d94b5093e9 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:53.176605 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c8c6193c-280f-4a4f-975d-31e02c629d7f req-9b54af88-18ba-4fdc-ba47-01d94b5093e9 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:53.177183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c8c6193c-280f-4a4f-975d-31e02c629d7f req-9b54af88-18ba-4fdc-ba47-01d94b5093e9 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:53.203300 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-c8c6193c-280f-4a4f-975d-31e02c629d7f req-9b54af88-18ba-4fdc-ba47-01d94b5093e9 service nova] Creating event network-changed:628ce1e2-6bc7-43e7-a353-8dbcabd8373f for instance efc18513-a02d-498d-9607-46c4bbd2306a on hv-cinder-85221 Sep 01 17:31:53.215046 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-c8c6193c-280f-4a4f-975d-31e02c629d7f req-9b54af88-18ba-4fdc-ba47-01d94b5093e9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377082 Sep 01 17:31:53.222579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 47/111] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:53.247302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:53.259348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-bfcdc87e-65ba-4556-8853-266489c718fe tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.262985 Sep 01 17:31:53.264614 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 65/112] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:52 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:53.536463 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:53.538006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:53.548261 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:53.548972 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:53.549616 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:53.550779 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:53.551572 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:53.552359 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:53.713135 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:53.714212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:53.729049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:53.731447 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:53.732041 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:53.735632 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:53.736432 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:53.739857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:53.757241 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:53.767107 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:53.778119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:53.779883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7a78c8b6-1de1-4fc4-9457-0194f8a30e83 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.247587 Sep 01 17:31:53.780818 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 48/113] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:53 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:53.982808 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:53.991923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f297a8b1-5e8e-499f-a90e-c9a1fbfbaddc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.283751 Sep 01 17:31:53.992747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 66/114] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:53 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:54.284785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:54.285536 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:54.293501 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:54.294765 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:54.295370 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:54.296055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:54.296647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:54.297383 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:54.454044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:54.462456 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e3913f16-354d-4b55-81d3-1f9dd1d6e540 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.182014 Sep 01 17:31:54.475837 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 49/115] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:54 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:54.818194 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:54.821559 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:54.832390 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:54.833437 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:54.834088 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:54.835574 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:54.836302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:54.837007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:55.016570 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:55.017280 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:55.034023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:55.034520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:55.037138 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:55.037936 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:55.038412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:55.038846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:55.194331 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:55.217331 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:55.219950 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:55.222557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0793159c-265d-4425-91e8-0b69c97c1bd8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.419833 Sep 01 17:31:55.224175 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 67/116] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:54 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:55.249776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-6e9fd130-1a06-44d8-8033-3fad91c0d997 req-d4b3313a-3995-4878-912e-c92b96c2f5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61004bf-b919-4848-8efa-ba83a2a8e633", "tag": "57a21496-3b93-45c7-9205-d2fd2b7131e5"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:31:55.264525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:55.271003 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6e9fd130-1a06-44d8-8033-3fad91c0d997 req-d4b3313a-3995-4878-912e-c92b96c2f5d2 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:55.271732 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6e9fd130-1a06-44d8-8033-3fad91c0d997 req-d4b3313a-3995-4878-912e-c92b96c2f5d2 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:55.272657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6e9fd130-1a06-44d8-8033-3fad91c0d997 req-d4b3313a-3995-4878-912e-c92b96c2f5d2 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:55.275277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a4a3d708-9051-4101-9af4-3e07e14f980c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.265622 Sep 01 17:31:55.276899 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 50/117] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:55 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:55.304257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-6e9fd130-1a06-44d8-8033-3fad91c0d997 req-d4b3313a-3995-4878-912e-c92b96c2f5d2 service nova] Creating event network-changed:57a21496-3b93-45c7-9205-d2fd2b7131e5 for instance b61004bf-b919-4848-8efa-ba83a2a8e633 on hv-cinder-85221 Sep 01 17:31:55.305262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6e9fd130-1a06-44d8-8033-3fad91c0d997 req-d4b3313a-3995-4878-912e-c92b96c2f5d2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 17:31:55.306081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6e9fd130-1a06-44d8-8033-3fad91c0d997 req-d4b3313a-3995-4878-912e-c92b96c2f5d2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 17:31:55.315066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b889ff32-a6d8-46ba-aa0e-17b3093c9287 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:55.315779 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b889ff32-a6d8-46ba-aa0e-17b3093c9287 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:55.316743 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b889ff32-a6d8-46ba-aa0e-17b3093c9287 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:55.318750 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b889ff32-a6d8-46ba-aa0e-17b3093c9287 None None] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:55.319441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b889ff32-a6d8-46ba-aa0e-17b3093c9287 None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:55.319932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b889ff32-a6d8-46ba-aa0e-17b3093c9287 None None] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:55.344878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.compute.rpcapi [None req-b889ff32-a6d8-46ba-aa0e-17b3093c9287 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 17:31:55.346557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b889ff32-a6d8-46ba-aa0e-17b3093c9287 None None] Releasing lock "compute-rpcapi-router" {{(pid=121744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 17:31:55.366866 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b889ff32-a6d8-46ba-aa0e-17b3093c9287 None None] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125022 Sep 01 17:31:55.367565 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 68/118] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:31:55.482354 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:55.482965 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:55.489624 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:55.490301 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:55.490936 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:55.491831 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:55.492447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:55.493045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:55.651947 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:55.663131 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0fc22c26-21e0-4ef8-9321-93b6641b4127 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.183470 Sep 01 17:31:55.663973 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 51/119] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:55 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:31:56.247117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:56.248220 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:56.260799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:56.262209 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:56.263715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:56.264674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:56.265365 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:56.266014 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:56.299127 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:56.299778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:56.306487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:56.307081 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:56.307686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:56.308412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:56.309205 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:56.309968 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:56.477131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:56.495365 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:56.502247 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:56.503659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-59895712-e05c-42d0-9aca-ba448d057a33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.261288 Sep 01 17:31:56.504288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 69/120] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:56 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:56.522826 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:56.526510 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:56.533606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-95820259-8127-4cd1-9cd3-87acc8a84de1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.238499 Sep 01 17:31:56.534227 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 52/121] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:56 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:31:56.686485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:56.687495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:56.694393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:56.695030 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:56.695622 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:56.696416 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:56.697219 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:56.697980 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:56.886552 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:56.896020 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-12651c4b-1eb7-42a9-a8cf-30f9eff345b5 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.213463 Sep 01 17:31:56.897118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 70/122] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:56 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:57.530228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:57.531094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:57.539592 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:57.539880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:57.541907 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:57.545371 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:57.555057 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:57.556505 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:57.560377 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:57.564237 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:57.571433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:57.574152 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:57.574832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:57.575767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:57.576256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:57.581216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:57.593860 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:31:57.824423 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:57.832173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-942a477b-d70c-451f-ba9e-23962f840efa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.281406 Sep 01 17:31:57.832934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 71/123] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:57 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:31:57.919749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:57.920605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:57.927558 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:57.928157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:57.933185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:57.934210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:57.935158 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:57.935816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:57.936433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:57.942818 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:57.946951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:57.950727 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-50525c71-6c98-4136-ab5d-d78b83f04ad2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.423379 Sep 01 17:31:57.966958 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 53/124] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:57 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:31:58.294231 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:58.303629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3cc1e47e-0bc2-4489-a641-f9b2e376fecd tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.389201 Sep 01 17:31:58.304705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 72/125] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:57 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:31:58.856813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:58.857439 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:58.864650 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:58.865274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:58.865930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:58.866955 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:58.867399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:58.867963 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:58.976813 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:58.977473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:58.986053 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:58.986521 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:58.986948 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:58.987634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:58.988092 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:58.988506 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:59.046067 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:59.065157 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-46ff3f86-bbe8-4837-a2d3-0c5f39f73162 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.212877 Sep 01 17:31:59.067254 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 54/126] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:58 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:31:59.221757 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:59.237610 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:59.242899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:59.245428 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d8a10971-2e51-4325-bd64-3a7a087fccc4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.272146 Sep 01 17:31:59.251894 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 73/127] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:31:58 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:31:59.328098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:31:59.328932 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:31:59.339527 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:59.343073 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:59.343971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:59.347790 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:31:59.349421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:31:59.351585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:31:59.623336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:31:59.635630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ff34d7f5-8c54-426d-956a-37ddf3da12be tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.312730 Sep 01 17:31:59.638016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 55/128] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:31:59 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:00.090685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:00.092206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:00.100452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:00.101225 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:00.102485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:00.104183 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:00.105678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:00.107076 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:00.272467 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:00.282777 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9955b295-699a-4ab2-b78e-e0550410254d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.197879 Sep 01 17:32:00.296842 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 74/129] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:00 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:00.303964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:00.304799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:00.312887 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:00.313404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:00.314631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:00.315513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:00.316111 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:00.317352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:00.467498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:00.477732 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:00.479382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:00.480612 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-32bd7fb6-c481-45a1-9ddc-7b75295e9a4c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.181971 Sep 01 17:32:00.482089 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 75/130] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:00 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:32:00.579674 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-56cae35a-5053-4e1d-83db-dd25af17ebe8 req-91254d64-56c1-42fe-877e-4988aa870768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f82500-1b55-4e1c-985a-c30b9ed0c0e9", "name": "network-vif-plugged", "status": "completed", "tag": "08adab5a-ac54-4387-b5b3-a054ac79c9fc"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:00.595821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-56cae35a-5053-4e1d-83db-dd25af17ebe8 req-91254d64-56c1-42fe-877e-4988aa870768 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:00.596743 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-56cae35a-5053-4e1d-83db-dd25af17ebe8 req-91254d64-56c1-42fe-877e-4988aa870768 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:00.597410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-56cae35a-5053-4e1d-83db-dd25af17ebe8 req-91254d64-56c1-42fe-877e-4988aa870768 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:00.609472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-56cae35a-5053-4e1d-83db-dd25af17ebe8 req-91254d64-56c1-42fe-877e-4988aa870768 service nova] Creating event network-vif-plugged:08adab5a-ac54-4387-b5b3-a054ac79c9fc for instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 on hv-cinder-85221 Sep 01 17:32:00.614747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-56cae35a-5053-4e1d-83db-dd25af17ebe8 req-91254d64-56c1-42fe-877e-4988aa870768 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.392758 Sep 01 17:32:00.618493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 56/131] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:32:00.659715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:00.660663 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:00.666771 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:00.667245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:00.667671 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:00.668344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:00.669669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:00.670293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:00.874189 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:00.884913 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-df9a0ca4-92e8-4bbc-bc57-409fee547821 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.229569 Sep 01 17:32:00.885706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 76/132] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:00 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:01.304941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:01.305679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:01.319432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:01.319873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:01.320311 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:01.321154 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:01.343112 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:01.343600 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:01.504324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:01.504324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:01.516247 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:01.517018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:01.517819 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:01.518693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:01.519505 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:01.520063 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:01.735840 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:01.748075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:01.749874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:01.751313 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7f4bdb77-1c54-4c2f-bd02-035eac3e6e7b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.251848 Sep 01 17:32:01.752307 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 77/133] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:01 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:32:01.912019 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:01.913016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:01.921664 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:01.922317 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:01.923483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:01.924400 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:01.925210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:01.926165 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:01.931166 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:01.944189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-28522231-e2c7-4c63-bd33-4874ef1ad724 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.643976 Sep 01 17:32:01.945284 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 57/134] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:01 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:02.142439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:02.151745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-40a36c68-a61d-402d-96b4-a529e6554455 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.246051 Sep 01 17:32:02.155744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 78/135] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:01 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:02.633636 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-f79253de-aa35-4207-a3e1-1856563d18da req-893b789e-483d-4cc8-a6a0-6f5583a82763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231831c1-c79e-41c4-876b-bc6e8be8aa3f", "name": "network-vif-plugged", "status": "completed", "tag": "41081b73-d685-4bd4-9f3d-2c08efd343a7"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:02.654120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-f79253de-aa35-4207-a3e1-1856563d18da req-893b789e-483d-4cc8-a6a0-6f5583a82763 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:02.654946 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-f79253de-aa35-4207-a3e1-1856563d18da req-893b789e-483d-4cc8-a6a0-6f5583a82763 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:02.655658 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-f79253de-aa35-4207-a3e1-1856563d18da req-893b789e-483d-4cc8-a6a0-6f5583a82763 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:02.675162 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-f79253de-aa35-4207-a3e1-1856563d18da req-893b789e-483d-4cc8-a6a0-6f5583a82763 service nova] Creating event network-vif-plugged:41081b73-d685-4bd4-9f3d-2c08efd343a7 for instance 231831c1-c79e-41c4-876b-bc6e8be8aa3f on hv-cinder-85221 Sep 01 17:32:02.681606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-f79253de-aa35-4207-a3e1-1856563d18da req-893b789e-483d-4cc8-a6a0-6f5583a82763 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052746 Sep 01 17:32:02.682365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 58/136] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:32:02.777113 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:02.778981 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:02.785562 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:02.786165 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:02.787357 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:02.788269 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:02.789889 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:02.791321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:02.958175 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:02.968911 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:02.969395 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:02.970494 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:02.971275 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:02.972024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e40a39b9-1e53-4fc2-bd46-9d1855401e33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.199800 Sep 01 17:32:02.972868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 79/137] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:02 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:32:02.978620 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:02.979174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:02.979805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:02.980604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:02.981190 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:02.981720 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:03.126935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:03.134842 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0a3e6b99-4443-478e-af80-562765e876e6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.170202 Sep 01 17:32:03.135406 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 59/138] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:02 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:03.173706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:03.174315 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:03.180561 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:03.181220 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:03.181823 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:03.182507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:03.182950 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:03.183364 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:03.377161 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:03.389022 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-136c9b30-7e43-4989-b060-60fbf4b20924 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.219181 Sep 01 17:32:03.391301 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 80/139] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:03 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:03.996274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:03.997606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:04.009217 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:04.014587 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:04.015670 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:04.016810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:04.020020 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:04.022483 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:04.157251 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:04.159219 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:04.170823 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:04.174521 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:04.175392 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:04.176430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:04.177052 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:04.177663 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:04.453844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:04.461728 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7aaa667e-3e91-401d-a967-1c2653aa166c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.309798 Sep 01 17:32:04.462273 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 81/140] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:04 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:04.478526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:04.479098 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:04.494977 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:04.495469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:04.495899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:04.497128 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:04.497604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:04.498024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:04.691414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:04.704524 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:04.708033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:04.713362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-06e64bf5-09aa-48db-82cc-58a495e05642 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.719227 Sep 01 17:32:04.730539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 60/141] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:03 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:32:04.892474 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:04.905021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-590bc108-07a0-4411-ab6f-1c80be43a57a tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.434525 Sep 01 17:32:04.905627 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 82/142] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:04 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:05.484824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:05.485526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:05.491741 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:05.492231 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:05.492663 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:05.493528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:05.493984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:05.494411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:05.645063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:05.654045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-af0e1d4c-4980-4f58-a921-e47a5680b2a2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.174473 Sep 01 17:32:05.654876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 61/143] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:05 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:05.741859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:05.741859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:05.748326 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:05.750696 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:05.751396 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:05.752783 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:05.754003 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:05.754611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:05.755184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:05.927702 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:05.928417 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:05.944082 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:05.944256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:05.944681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:05.945121 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:05.946414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:05.947040 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:05.947619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:05.953784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:05.956079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:05.957426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f456ce79-6904-4de4-be66-ad3ca3862a78 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.223726 Sep 01 17:32:05.958155 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 83/144] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:05 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:32:06.099091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:06.108951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6b7d0919-2662-48c1-a605-dead9f48b856 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.186069 Sep 01 17:32:06.110473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 62/145] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:05 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:06.494425 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-8bd4eb21-cc6c-4c20-a8e4-96745441f265 req-63202b84-e4c9-4db4-9859-b75536cb93c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc18513-a02d-498d-9607-46c4bbd2306a", "name": "network-vif-plugged", "status": "completed", "tag": "628ce1e2-6bc7-43e7-a353-8dbcabd8373f"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:06.519416 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-8bd4eb21-cc6c-4c20-a8e4-96745441f265 req-63202b84-e4c9-4db4-9859-b75536cb93c6 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:06.519968 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-8bd4eb21-cc6c-4c20-a8e4-96745441f265 req-63202b84-e4c9-4db4-9859-b75536cb93c6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:06.520856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-8bd4eb21-cc6c-4c20-a8e4-96745441f265 req-63202b84-e4c9-4db4-9859-b75536cb93c6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:06.553319 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-8bd4eb21-cc6c-4c20-a8e4-96745441f265 req-63202b84-e4c9-4db4-9859-b75536cb93c6 service nova] Creating event network-vif-plugged:628ce1e2-6bc7-43e7-a353-8dbcabd8373f for instance efc18513-a02d-498d-9607-46c4bbd2306a on hv-cinder-85221 Sep 01 17:32:06.560585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-8bd4eb21-cc6c-4c20-a8e4-96745441f265 req-63202b84-e4c9-4db4-9859-b75536cb93c6 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072581 Sep 01 17:32:06.561705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 84/146] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:32:06.676183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:06.676809 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:06.688262 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:06.688971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:06.689440 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:06.690228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:06.691360 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:06.691833 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:06.937231 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:06.947207 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d110a348-3811-47ed-aa4b-a4ccc7416e63 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.275642 Sep 01 17:32:06.948236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 63/147] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:06 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:06.983436 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:06.985432 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:06.992619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:06.993185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:06.993906 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:06.994661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:06.995215 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:06.996437 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:07.133351 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:07.134243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:07.148362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:07.149328 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:07.149781 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:07.151720 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:07.152362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:07.155628 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:07.244780 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:07.257649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:07.259519 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:07.261691 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e98218ea-a99c-4284-934f-800731dd42ce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.282950 Sep 01 17:32:07.264567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 85/148] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:06 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:32:07.782167 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:07.794846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6e19d40b-151d-4dbd-9592-7ff7b3adcf92 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1318 microversion: 2.1 time: 0.666750 Sep 01 17:32:07.797565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 64/149] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:07 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:07.971258 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:07.972253 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:07.979663 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:07.980435 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:07.981697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:07.982753 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:07.983398 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:07.984004 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:08.197699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:08.210206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-510efd96-3025-4c5d-9f43-cf060b4255ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1326 microversion: 2.1 time: 0.243298 Sep 01 17:32:08.211076 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 86/150] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:07 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1326 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:08.290299 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:08.290899 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:08.299615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:08.300112 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:08.300515 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:08.301205 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:08.301695 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:08.302094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:08.474498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:08.484900 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:08.486647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:08.488397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-01e52660-b813-498e-a24e-33e6856f0682 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.201819 Sep 01 17:32:08.501817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 65/151] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:08 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:32:08.825337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:08.827899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:08.851899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:08.854815 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:08.856680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:08.859745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:08.861149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:08.862304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:08.998383 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-d40cecfb-2928-4ff9-8e9d-54d314145914 req-be3aec1d-ad6a-4979-902c-95b3c2279a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61004bf-b919-4848-8efa-ba83a2a8e633", "name": "network-vif-plugged", "status": "completed", "tag": "57a21496-3b93-45c7-9205-d2fd2b7131e5"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:09.012932 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-d40cecfb-2928-4ff9-8e9d-54d314145914 req-be3aec1d-ad6a-4979-902c-95b3c2279a61 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:09.013440 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-d40cecfb-2928-4ff9-8e9d-54d314145914 req-be3aec1d-ad6a-4979-902c-95b3c2279a61 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:09.013853 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-d40cecfb-2928-4ff9-8e9d-54d314145914 req-be3aec1d-ad6a-4979-902c-95b3c2279a61 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:09.025334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-d40cecfb-2928-4ff9-8e9d-54d314145914 req-be3aec1d-ad6a-4979-902c-95b3c2279a61 service nova] Creating event network-vif-plugged:57a21496-3b93-45c7-9205-d2fd2b7131e5 for instance b61004bf-b919-4848-8efa-ba83a2a8e633 on hv-cinder-85221 Sep 01 17:32:09.030913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-d40cecfb-2928-4ff9-8e9d-54d314145914 req-be3aec1d-ad6a-4979-902c-95b3c2279a61 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036824 Sep 01 17:32:09.032075 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 66/152] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:32:09.084428 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:09.093363 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0dffa3b8-d5f4-4850-b3ca-8addafbbaddf tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1504 microversion: 2.1 time: 0.280986 Sep 01 17:32:09.109002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 87/153] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:08 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:09.236869 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:09.237591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:09.245206 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:09.246179 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:09.248288 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:09.249289 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:09.250225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:09.251011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:09.415204 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:09.423728 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-63e6ac6f-bacf-48d4-be67-6c89d7c363e3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1519 microversion: 2.1 time: 0.194096 Sep 01 17:32:09.424588 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 67/154] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:09 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:09.444819 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:09.447087 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:09.454317 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:09.455033 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:09.455912 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:09.456805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:09.457492 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:09.458143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:09.512965 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:09.513714 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:09.526480 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:09.526480 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:09.526882 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:09.528166 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:09.528947 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:09.529534 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:09.573490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:09.580350 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lazy-loading 'flavor' on Instance uuid 231831c1-c79e-41c4-876b-bc6e8be8aa3f {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:32:09.702498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:09.712198 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:09.713666 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:09.714797 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ee57cc31-fe6a-4388-bffa-72571c27ace1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.206494 Sep 01 17:32:09.715578 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 68/155] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:09 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:32:09.736482 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5997e181-241d-4eb2-9fcb-e488e907f280 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f/action" status: 200 len: 32 microversion: 2.1 time: 0.295611 Sep 01 17:32:09.737057 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 88/156] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:32:09 2022] POST /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:32:09.746960 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:09.747593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:09.753740 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:09.754221 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:09.754653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:09.755344 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:09.755787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:09.756205 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:09.897060 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:09.904916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9ba67ed6-7356-461a-8b63-4f6b9a32304c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.162369 Sep 01 17:32:09.905507 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 69/157] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:09 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:10.739828 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:10.740512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:10.746941 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:10.747416 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:10.748057 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:10.748931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:10.749583 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:10.750438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:10.932479 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:10.933956 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:10.943041 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:10.945022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:10.945830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:10.946593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:10.947580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:10.948613 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:10.953093 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:10.954272 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:10.956290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:10.957820 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e0a0ece8-9f32-43ce-85f9-221e8a55edce tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.223269 Sep 01 17:32:10.958845 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 89/158] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:10 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:32:11.212243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:11.226631 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-22d51b6c-6099-43cf-92da-a861386e7fad tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.305238 Sep 01 17:32:11.237329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 70/159] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:10 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:11.757791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d2febc05-1370-4f82-9bc7-d48d9837488d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09beeca6-3cb1-44a8-8dc9-d2e2592cc69d"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:11.760188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d2febc05-1370-4f82-9bc7-d48d9837488d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:11.766459 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2febc05-1370-4f82-9bc7-d48d9837488d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:11.766941 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2febc05-1370-4f82-9bc7-d48d9837488d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:11.767366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2febc05-1370-4f82-9bc7-d48d9837488d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:11.768093 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2febc05-1370-4f82-9bc7-d48d9837488d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:11.768652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2febc05-1370-4f82-9bc7-d48d9837488d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:11.769068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2febc05-1370-4f82-9bc7-d48d9837488d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:11.983181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:11.983787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:11.989864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:11.990342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:11.990771 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:11.991454 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:11.991901 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:11.992319 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:12.013572 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:12.137415 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:12.145442 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:12.147022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:12.148124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6d356504-5cf0-45c2-a4db-0b00c39a2adc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.169513 Sep 01 17:32:12.148759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 71/160] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:11 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:32:12.252743 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:12.253872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:12.267645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:12.268391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:12.270869 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:12.272699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:12.273562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:12.274355 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:12.555029 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:12.573890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2be21fc1-c280-432f-8b29-4c1e831f16c1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.326155 Sep 01 17:32:12.576709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 72/161] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:12 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:13.174306 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:13.174999 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:13.193183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:13.193696 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:13.194121 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:13.194807 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:13.195247 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:13.195655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:13.367598 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:13.376338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:13.377791 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:13.379096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-22389dfb-b89d-457f-86ee-2b01040a152d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.209843 Sep 01 17:32:13.380087 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 73/162] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:13 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:32:13.596521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:13.597536 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:13.603991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:13.604690 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:13.605935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:13.606860 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:13.607765 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:13.608430 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:13.795327 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:13.805811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b9f1d225-9ba2-4e5b-8687-9aea9de518f9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.213074 Sep 01 17:32:13.807443 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 74/163] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:13 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:14.401865 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:14.403186 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:14.409285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:14.410228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:14.410904 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:14.411656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:14.412162 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:14.412581 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:14.626438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:14.636890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:14.639477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:14.640849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8d6a9259-6ca4-40af-a121-5419c8762bed tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1409 microversion: 2.20 time: 0.242754 Sep 01 17:32:14.641685 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 75/164] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:14 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1409 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:32:14.723203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d2febc05-1370-4f82-9bc7-d48d9837488d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "POST /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.969311 Sep 01 17:32:14.724177 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 90/165] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:32:11 2022] POST /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9/os-volume_attachments => generated 194 bytes in 2971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:32:14.827399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:14.828276 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:14.835937 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:14.836527 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:14.837041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:14.837849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:14.838510 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:14.839007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:15.035672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:15.048085 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1c79146a-4057-4189-b39e-0610776ed817 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.224748 Sep 01 17:32:15.050914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 76/166] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:14 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:15.667220 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:15.668174 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:15.682413 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:15.682903 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:15.684008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:15.684738 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:15.685207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:15.685811 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:16.008721 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:16.020012 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:16.021498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:16.022877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3af6cd7a-66bf-43c4-8d0c-4c2b1b17023a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1600 microversion: 2.20 time: 0.360927 Sep 01 17:32:16.038952 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 91/167] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:32:15 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1600 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:32:16.051481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a5547667-c90b-4ae7-b928-07e9f5184fee tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:16.052070 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a5547667-c90b-4ae7-b928-07e9f5184fee tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:16.064758 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5547667-c90b-4ae7-b928-07e9f5184fee tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:16.066701 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5547667-c90b-4ae7-b928-07e9f5184fee tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:16.072081 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5547667-c90b-4ae7-b928-07e9f5184fee tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:16.072348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5547667-c90b-4ae7-b928-07e9f5184fee tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:16.075410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:16.076593 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:16.087650 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:16.087908 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5547667-c90b-4ae7-b928-07e9f5184fee tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:16.088684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5547667-c90b-4ae7-b928-07e9f5184fee tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:16.101011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:16.104127 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:16.111257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:16.113640 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:16.115261 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:16.346128 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a5547667-c90b-4ae7-b928-07e9f5184fee tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.298419 Sep 01 17:32:16.349058 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 77/168] 10.222.0.102 () {60 vars in 1321 bytes} [Thu Sep 1 17:32:16 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-interface => generated 284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:32:16.593647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:16.602264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a1819fc9-eea4-48ac-8310-3eefb79d5753 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.534200 Sep 01 17:32:16.605456 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 92/169] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:16 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:17.623404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:17.624753 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:17.637254 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:17.637797 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:17.638794 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:17.640809 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:17.641671 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:17.644781 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:17.819527 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:17.831747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1648f267-a40c-4a7a-884b-fd95effdcec2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.211633 Sep 01 17:32:17.834342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 78/170] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:17 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:18.295400 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-1436fa70-1f7f-4fd6-859c-8fb311eb39b5 req-c334c9ef-ec5c-471f-8029-dbb3e55a4c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61004bf-b919-4848-8efa-ba83a2a8e633", "tag": "57a21496-3b93-45c7-9205-d2fd2b7131e5"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:18.306063 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-1436fa70-1f7f-4fd6-859c-8fb311eb39b5 req-c334c9ef-ec5c-471f-8029-dbb3e55a4c87 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:18.306885 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-1436fa70-1f7f-4fd6-859c-8fb311eb39b5 req-c334c9ef-ec5c-471f-8029-dbb3e55a4c87 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:18.307504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-1436fa70-1f7f-4fd6-859c-8fb311eb39b5 req-c334c9ef-ec5c-471f-8029-dbb3e55a4c87 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:18.319595 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-1436fa70-1f7f-4fd6-859c-8fb311eb39b5 req-c334c9ef-ec5c-471f-8029-dbb3e55a4c87 service nova] Creating event network-changed:57a21496-3b93-45c7-9205-d2fd2b7131e5 for instance b61004bf-b919-4848-8efa-ba83a2a8e633 on hv-cinder-85221 Sep 01 17:32:18.325053 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-1436fa70-1f7f-4fd6-859c-8fb311eb39b5 req-c334c9ef-ec5c-471f-8029-dbb3e55a4c87 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032609 Sep 01 17:32:18.326198 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 93/171] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:32:18.859653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:18.860539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:18.863393 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=73 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:18.867200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:18.867675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:18.868284 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:18.868971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:18.869459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:18.869962 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:19.024339 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:19.034091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-de8a3253-8f76-4f26-85f7-cfed2e397b39 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.178700 Sep 01 17:32:19.034910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 79/172] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:18 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:19.212979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1561867016", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "networks": [{"uuid": "38e58b72-27dd-45af-8473-2e297559f6e2"}]}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:19.285197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] validate_networks() for [('38e58b72-27dd-45af-8473-2e297559f6e2', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:32:19.827489 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:32:19.828082 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:32:19.828507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:32:19.829201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:32:19.829647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:32:19.832300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=68 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:19.841356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:19.842063 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:19.842620 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:19.843501 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:19.844018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:19.844385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:19.866591 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Getting quotas for project 5f5e7805e6ae4547a767b7b382a78082. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:32:19.874396 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Getting quotas for user b54b95db13d84fc4b026fdd119cb7ec5 and project 5f5e7805e6ae4547a767b7b382a78082. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:32:19.888231 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:32:19.890721 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:32:19.945622 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3aa17152-d639-4927-8417-2d1e9eea4be5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.739182 Sep 01 17:32:19.945936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 94/173] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:32:19 2022] POST /compute/v2.1/servers => generated 382 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:32:19.957151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-deb7ffc4-d2bb-49b1-a060-a41282220008 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:19.957867 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-deb7ffc4-d2bb-49b1-a060-a41282220008 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:20.020205 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-deb7ffc4-d2bb-49b1-a060-a41282220008 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:20.044529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-deb7ffc4-d2bb-49b1-a060-a41282220008 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1218 microversion: 2.1 time: 0.091363 Sep 01 17:32:20.045811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 80/174] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:19 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:20.055802 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:20.056407 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:20.069419 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:20.070033 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:20.071142 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:20.073099 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:20.074260 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:20.075003 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:20.223140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:20.231735 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-73666e15-aadc-4d4a-a7b1-1feb624bbe3d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.179993 Sep 01 17:32:20.232326 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 95/175] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:20 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:21.066649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:21.067602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:21.075263 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:21.075752 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:21.076181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:21.077063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:21.077561 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:21.077987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:21.156018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:21.164669 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b301d2e0-c256-479d-b789-59b20e54056a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1270 microversion: 2.1 time: 0.102908 Sep 01 17:32:21.165588 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 81/176] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:21 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:21.253279 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:21.253936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:21.260430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:21.260922 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:21.261426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:21.262118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:21.262741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:21.263163 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:21.394495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:21.403461 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-654cdff3-36ee-443b-b924-a0d4396879a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.153996 Sep 01 17:32:21.404125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 96/177] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:21 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:22.187093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:22.188187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:22.198344 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:22.198940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:22.200945 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:22.201767 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:22.202705 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:22.204333 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:22.312051 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:22.324313 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-00b87494-c540-4651-9b9f-3a6715918dd0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1276 microversion: 2.1 time: 0.142375 Sep 01 17:32:22.324833 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 82/178] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:22 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:22.424547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:22.425154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:22.432214 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:22.432915 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:22.433541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:22.434234 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:22.434734 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:22.435152 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:22.582330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:22.590902 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f8f6cb4f-526d-4bed-a01a-8f786d225615 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.170160 Sep 01 17:32:22.591646 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 97/179] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:22 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:23.242695 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-91be5e27-1cb5-4999-8444-72de0ea5167b req-559cbfa1-6ec5-4fb6-8461-422b0deef24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd7db1aa-13fc-4583-ad20-ca91054be971", "tag": "d1df7c81-a1ca-46b7-a600-d567e4b689e3"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:23.252555 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-91be5e27-1cb5-4999-8444-72de0ea5167b req-559cbfa1-6ec5-4fb6-8461-422b0deef24f service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:23.252925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-91be5e27-1cb5-4999-8444-72de0ea5167b req-559cbfa1-6ec5-4fb6-8461-422b0deef24f service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:23.253373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-91be5e27-1cb5-4999-8444-72de0ea5167b req-559cbfa1-6ec5-4fb6-8461-422b0deef24f service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:23.269799 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-91be5e27-1cb5-4999-8444-72de0ea5167b req-559cbfa1-6ec5-4fb6-8461-422b0deef24f service nova] Creating event network-changed:d1df7c81-a1ca-46b7-a600-d567e4b689e3 for instance fd7db1aa-13fc-4583-ad20-ca91054be971 on hv-cinder-85221 Sep 01 17:32:23.278802 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-91be5e27-1cb5-4999-8444-72de0ea5167b req-559cbfa1-6ec5-4fb6-8461-422b0deef24f service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039526 Sep 01 17:32:23.279510 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 83/180] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:32:23.345157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:23.346066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:23.352029 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:23.352511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:23.352943 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:23.353873 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:23.354326 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:23.354975 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:23.495078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:23.503631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8e82bbfc-0f3d-4f2d-a576-f1d289245246 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.162337 Sep 01 17:32:23.504205 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 98/181] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:23 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:23.615343 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:23.616056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:23.622965 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:23.623433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:23.623865 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:23.624534 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:23.625061 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:23.625700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:23.758676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:23.766324 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-29d21100-2bcf-4b23-97c5-71339a4c10d4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.158113 Sep 01 17:32:23.767168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 84/182] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:23 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:24.523835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:24.524440 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:24.531705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:24.532181 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:24.532610 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:24.533285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:24.533754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:24.534334 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:24.682551 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:24.690978 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5a6a3a9c-e630-40d5-8984-68300ef8e09b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.170878 Sep 01 17:32:24.691717 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 99/183] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:24 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:24.788771 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:24.789406 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:24.796949 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:24.798621 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:24.799479 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:24.800391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:24.800933 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:24.802287 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:24.988072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:24.997282 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6eb9bff1-8461-47a9-a0f6-a8f07e0623bb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.212533 Sep 01 17:32:24.997886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 85/184] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:24 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:25.712148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:25.712715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:25.719605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:25.720078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:25.720754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:25.721445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:25.721892 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:25.722305 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:25.847247 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:25.854998 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5ebe099c-1b9a-4fbe-a881-12f248c1c4ab tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.146674 Sep 01 17:32:25.855562 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 100/185] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:25 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:26.020084 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:26.020714 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:26.027293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:26.027767 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:26.028190 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:26.028956 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:26.029426 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:26.029846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:26.194499 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:26.202776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-99099e92-aaaf-4dfa-a7cb-f3b429fd99e9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.186599 Sep 01 17:32:26.203338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 86/186] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:26 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:26.876018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:26.876630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:26.883180 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:26.883874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:26.884474 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:26.885395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:26.885856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:26.886279 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:27.036530 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:27.045514 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-912b253f-c110-4a6b-8fe6-5c583bea4271 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.173497 Sep 01 17:32:27.046134 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 101/187] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:26 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:27.223123 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:27.223749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:27.230542 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:27.231017 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:27.231454 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:27.232135 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:27.232588 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:27.233009 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:27.363559 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:27.372473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9399bf90-2b70-4b8b-a15a-fa5bbc41b675 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.153406 Sep 01 17:32:27.373301 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 87/188] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:27 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:27.697287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:27.697816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:27.704286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:27.704767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:27.705197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:27.705905 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:27.706356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:27.706772 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:27.731195 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:32:27.746059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:27.819052 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-690c5e1b-55af-4f74-b176-a816a7a013c1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "DELETE /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 204 len: 0 microversion: 2.1 time: 0.125363 Sep 01 17:32:27.819660 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 102/189] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:32:27 2022] DELETE /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:32:27.828240 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:27.828835 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:27.834746 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:27.835219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:27.835648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:27.836321 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:27.836776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:27.837191 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:27.963646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:27.972687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-39b4d881-387b-47a0-9a17-e763a7ea5cef tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1556 microversion: 2.1 time: 0.148293 Sep 01 17:32:27.973238 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 88/190] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:27 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:28.068124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:28.068820 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:28.075222 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:28.075699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:28.076133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:28.076834 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:28.077274 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:28.077718 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:28.206698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:28.214857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-4f6c4003-61ca-4438-af86-967c0f94ed4f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.150959 Sep 01 17:32:28.215426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 103/191] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:28 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:28.395771 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:28.396532 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:28.404531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:28.405219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:28.405826 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:28.406824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:28.407948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:28.408581 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:28.580858 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:28.606198 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b7eab9cd-3a7d-4fb9-a9e0-959be3b4c2ff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.215501 Sep 01 17:32:28.607099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 89/192] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:28 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:28.994505 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:28.995114 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:29.002025 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:29.002827 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:29.003246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:29.003947 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:29.004404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:29.004834 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:29.139763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:29.148389 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-94a1848b-ee0a-4c64-a567-1d41ae88676d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1556 microversion: 2.1 time: 0.158114 Sep 01 17:32:29.148954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 104/193] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:28 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:29.239258 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:29.239803 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:29.246232 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:29.246708 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:29.247136 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:29.247813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:29.248267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:29.248669 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:29.267074 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:29.383094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:29.391574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-dac6a3a3-7281-43d8-a160-381ba3368d86 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.156103 Sep 01 17:32:29.392125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 90/194] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:29 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:29.632929 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:29.633842 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:29.650120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:29.650120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:29.650120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:29.650120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:29.650577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:29.650577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:29.789713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:29.797981 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0a8bed1d-809c-4f52-ae65-030a6ac21f60 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.171513 Sep 01 17:32:29.798797 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 105/195] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:29 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:30.169916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:30.170672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:30.172529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:30.178367 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:30.178839 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:30.179262 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:30.179945 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:30.180383 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:30.180795 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:30.317495 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:30.326508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7b8c167e-bb7f-40d0-9342-d6828b5f1141 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1556 microversion: 2.1 time: 0.161372 Sep 01 17:32:30.327068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 91/196] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:30 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:30.410964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:30.411577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:30.414500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:30.415151 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:30.420188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:30.420675 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:30.421111 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:30.421838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:30.422395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:30.422900 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:30.559989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:30.570486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-08defb8b-3560-4481-9707-e084e3221f43 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.163154 Sep 01 17:32:30.571074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 106/197] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:30 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:30.824126 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:30.825331 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:30.831452 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:30.831936 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:30.832401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:30.833093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:30.833736 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:30.834151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:30.986482 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:30.994180 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-19356ce4-3693-450e-a247-3895b2bfc652 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.178374 Sep 01 17:32:30.994684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 92/198] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:30 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:31.348089 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:31.348735 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:31.355407 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:31.355920 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:31.356356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:31.357046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:31.357611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:31.358039 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:31.494369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:31.502622 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-cfdfc387-cc8f-4421-8029-904cc9206e1c tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1556 microversion: 2.1 time: 0.158746 Sep 01 17:32:31.503276 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 107/199] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:31 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:31.592220 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:31.592754 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:31.598894 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:31.599365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:31.599791 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:31.600462 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:31.600909 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:31.601338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:31.736078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:31.744585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-72f27faf-026a-4960-849a-d4cc532ad88c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.156827 Sep 01 17:32:31.745498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 93/200] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:31 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:32.015480 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:32.016095 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:32.021985 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:32.022488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:32.022899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:32.023588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:32.024046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:32.024466 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:32.153754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:32.161511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-120b37b4-05b9-4e76-897c-a1c87be11f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.149985 Sep 01 17:32:32.162073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 108/201] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:32 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:32.524288 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:32.524898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:32.531409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:32.531889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:32.532323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:32.533039 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:32.533542 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:32.533957 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:32.669577 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:32.678756 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0628b7cd-0083-445f-a979-e6d566b0d7b9 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1556 microversion: 2.1 time: 0.158262 Sep 01 17:32:32.679477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 94/202] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:32 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:32.766739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:32.767349 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:32.773755 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:32.774240 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:32.774668 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:32.775360 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:32.775904 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:32.776785 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:33.182772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:33.183375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:33.189238 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:33.189740 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:33.190167 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:33.190842 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:33.191289 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:33.191706 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:33.326983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:33.334990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-43248005-f587-4df4-9fa8-44aa7c1d041f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.156620 Sep 01 17:32:33.335496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 95/203] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:33 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:33.402110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:33.410282 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b33c5920-6564-4bbe-89a9-fa5345abc5d3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.647359 Sep 01 17:32:33.410857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 109/204] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:32 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:33.700502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:33.701113 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:33.707267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:33.707751 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:33.708184 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:33.708866 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:33.709330 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:33.709790 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:33.985530 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:33.991853 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-9afe90fd-55d5-4b0e-91d1-180c463d54bc req-d1f5a92a-5c1d-49f8-9eea-f62dabfbc186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7db1aa-13fc-4583-ad20-ca91054be971", "name": "network-vif-plugged", "status": "completed", "tag": "d1df7c81-a1ca-46b7-a600-d567e4b689e3"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:34.001935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ba156ba5-6aed-4171-84c9-74f046abd224 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1556 microversion: 2.1 time: 0.305625 Sep 01 17:32:34.007581 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-9afe90fd-55d5-4b0e-91d1-180c463d54bc req-d1f5a92a-5c1d-49f8-9eea-f62dabfbc186 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:34.008413 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-9afe90fd-55d5-4b0e-91d1-180c463d54bc req-d1f5a92a-5c1d-49f8-9eea-f62dabfbc186 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:34.009097 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-9afe90fd-55d5-4b0e-91d1-180c463d54bc req-d1f5a92a-5c1d-49f8-9eea-f62dabfbc186 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:34.015391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 96/205] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:33 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1556 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:34.029622 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-9afe90fd-55d5-4b0e-91d1-180c463d54bc req-d1f5a92a-5c1d-49f8-9eea-f62dabfbc186 service nova] Creating event network-vif-plugged:d1df7c81-a1ca-46b7-a600-d567e4b689e3 for instance fd7db1aa-13fc-4583-ad20-ca91054be971 on hv-cinder-85221 Sep 01 17:32:34.034597 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-9afe90fd-55d5-4b0e-91d1-180c463d54bc req-d1f5a92a-5c1d-49f8-9eea-f62dabfbc186 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047539 Sep 01 17:32:34.035605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 110/206] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:32:34.355969 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:34.356513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:34.362618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:34.363110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:34.363540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:34.364224 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:34.364676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:34.365094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:34.434529 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:34.435232 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:34.441717 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:34.442494 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:34.442836 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:34.443563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:34.444010 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:34.444812 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:34.630839 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:34.640998 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0c707958-d788-4c80-aafd-f6edb926183b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.212094 Sep 01 17:32:34.641827 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 111/207] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:34 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:34.648688 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:34.656725 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-01773518-bc2f-4417-aa97-571c9f83789c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.304602 Sep 01 17:32:34.661947 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 97/208] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:34 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:35.026277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:35.026882 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:35.033232 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:35.033746 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:35.034410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:35.035285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:35.035910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:35.036503 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:35.209704 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:35.221749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2b9b5e59-f07b-4a32-9cec-70ef851a0862 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1556 microversion: 2.1 time: 0.199132 Sep 01 17:32:35.222341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 112/209] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:35 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:35.662433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:35.665007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:35.671099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:35.671505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:35.672094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:35.672776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:35.673222 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:35.673663 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:35.680315 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:35.681480 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:35.688165 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:35.688821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:35.689507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:35.690207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:35.690655 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:35.691265 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:35.817089 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:35.826395 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b64a5f11-4338-4cf1-b5a9-f58304913ccb tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.167842 Sep 01 17:32:35.827593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 98/210] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:35 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:35.848734 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:35.857100 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-64b5bfc2-24dc-4009-a239-e3d571adc68a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.180909 Sep 01 17:32:35.858374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 113/211] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:35 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:36.244277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:36.245590 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:36.258491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:36.258980 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:36.259391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:36.260070 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:36.260673 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:36.261092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:36.485648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:36.493796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8b0784d3-cfeb-4ffb-ba71-f812d51a973f tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1556 microversion: 2.1 time: 0.253407 Sep 01 17:32:36.494348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 99/212] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:36 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:36.658738 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-d83ecb49-a4c4-4cb5-9dc8-02ae77312f29 req-6f3af783-b899-44d5-96d3-a5a73b4debb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f82500-1b55-4e1c-985a-c30b9ed0c0e9", "name": "network-vif-deleted", "tag": "08adab5a-ac54-4387-b5b3-a054ac79c9fc"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:36.671865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-d83ecb49-a4c4-4cb5-9dc8-02ae77312f29 req-6f3af783-b899-44d5-96d3-a5a73b4debb2 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:36.672476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-d83ecb49-a4c4-4cb5-9dc8-02ae77312f29 req-6f3af783-b899-44d5-96d3-a5a73b4debb2 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:36.673079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-d83ecb49-a4c4-4cb5-9dc8-02ae77312f29 req-6f3af783-b899-44d5-96d3-a5a73b4debb2 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:36.685682 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-d83ecb49-a4c4-4cb5-9dc8-02ae77312f29 req-6f3af783-b899-44d5-96d3-a5a73b4debb2 service nova] Creating event network-vif-deleted:08adab5a-ac54-4387-b5b3-a054ac79c9fc for instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 on hv-cinder-85221 Sep 01 17:32:36.690620 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-d83ecb49-a4c4-4cb5-9dc8-02ae77312f29 req-6f3af783-b899-44d5-96d3-a5a73b4debb2 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035718 Sep 01 17:32:36.691280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 114/213] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:32:36.855449 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:36.856002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:36.861930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:36.862403 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:36.862850 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:36.863687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:36.864133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:36.864541 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:36.878174 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:36.879116 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:36.886038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:36.886713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:36.887302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:36.887984 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:36.888578 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:36.889139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:37.008407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:37.034187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-af6c03c7-093b-4957-a222-a1fe2250cab1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.190545 Sep 01 17:32:37.039816 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 100/214] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:36 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:37.053591 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:37.064094 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-322c58e8-c42f-4ccc-a5ae-169f2a291121 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.189829 Sep 01 17:32:37.064930 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 115/215] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:36 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:37.515504 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:37.516774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:37.524361 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:37.525154 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:37.525920 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:37.527073 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:37.527811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:37.528546 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:37.601925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:37.610102 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4bbed839-8d38-4b29-834c-c8edc9be209d tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1349 microversion: 2.1 time: 0.099009 Sep 01 17:32:37.610662 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 101/216] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:37 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:38.057808 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:38.058478 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:38.064983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:38.065556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:38.065932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:38.066616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:38.067068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:38.067487 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:38.086236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:38.087497 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:38.097442 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:38.099408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:38.100100 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:38.101585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:38.102160 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:38.102777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:38.227164 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:38.236001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-548ad6db-7866-413f-9bcf-2067b37a252f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1318 microversion: 2.1 time: 0.183157 Sep 01 17:32:38.236601 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 116/217] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:38 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:38.240647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:38.249101 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ab4606b4-9edd-483d-bd3b-3544be9787e8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.167425 Sep 01 17:32:38.249738 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 102/218] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:38 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:38.631058 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:38.631695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:38.638511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:38.638816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:38.639245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:38.639919 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:38.640363 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:38.640780 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:38.671669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:38.672145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:38.672574 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:38.673006 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lazy-loading 'fault' on Instance uuid 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:32:38.716045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a53d1e1a84408ea1dc2aba24bd8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f232c720f5a4108a46e79700be67099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:38.724388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c4af05bf-5228-4311-857f-226d5750dc90 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 200 len: 1354 microversion: 2.1 time: 0.097723 Sep 01 17:32:38.725172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 117/219] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:38 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 1354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:39.257399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:39.258282 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:39.265069 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:39.265577 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:39.266226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:39.267067 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:39.267556 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:39.267973 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:39.269681 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:39.270300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:39.276648 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:39.277128 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:39.277895 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:39.278306 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:39.278754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:39.279173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:39.411937 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:39.420916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fb1c7859-6c86-493f-ad68-11510ae83dc6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1503 microversion: 2.1 time: 0.168030 Sep 01 17:32:39.421738 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 103/220] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:39 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:39.425811 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:39.433495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-de94a809-2e55-4bb1-b738-66beb5e3ec67 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.167825 Sep 01 17:32:39.434262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 118/221] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:39 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:39.745355 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:39.746441 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:39.752168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:39.752638 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:39.753062 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:39.753758 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:39.754199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:39.754612 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:39.768723 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] HTTP exception thrown: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Request method failure captured: Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 HTTP/1.1 Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxsSenjnPGkJfCaqeJ3GySl1NFeN3x_uDTMx73zdi4IMIGkPwsb2P6sQT0y7MqvTsjA79PVLTC3uLpMO3y_UvvWcvYPuGcw520x77aZT6XsVm3kabcPa3dNYNo8zg0slg4OOijQ06GU1gS0-q5FwnEvT15V_u8ihREjwqHDbwTLdUg Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 1f232c720f5a4108a46e79700be67099 Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:32:39.773211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_1f232c720f5a4108a46e79700be67099", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1f232c720f5a4108a46e79700be67099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/1f232c720f5a4108a46e79700be67099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1f232c720f5a4108a46e79700be67099"}]}] Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 1f232c720f5a4108a46e79700be67099 Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-DeleteServersTestJSON-1717115575-project Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 19a53d1e1a84408ea1dc2aba24bd8299 Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-DeleteServersTestJSON-1717115575-project Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.774772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '35f82500-1b55-4e1c-985a-c30b9ed0c0e9'} Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:32:39.775716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.777125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.778409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Returning 404 to user: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:32:39.778409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-39d1c99b-81a8-4690-bed2-fd97da457aa1 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 404 len: 111 microversion: 2.1 time: 0.033303 Sep 01 17:32:39.778409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 104/222] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:39 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:32:39.891082 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:39.893285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:39.899290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:39.899795 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:39.900230 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:39.900941 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:39.901434 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:39.901958 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:39.906081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:39.916090 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] HTTP exception thrown: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Request method failure captured: Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9/os-volume_attachments HTTP/1.1 Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxsSenjnPGkJfCaqeJ3GySl1NFeN3x_uDTMx73zdi4IMIGkPwsb2P6sQT0y7MqvTsjA79PVLTC3uLpMO3y_UvvWcvYPuGcw520x77aZT6XsVm3kabcPa3dNYNo8zg0slg4OOijQ06GU1gS0-q5FwnEvT15V_u8ihREjwqHDbwTLdUg Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 1f232c720f5a4108a46e79700be67099 Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:32:39.921630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_1f232c720f5a4108a46e79700be67099", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1f232c720f5a4108a46e79700be67099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/1f232c720f5a4108a46e79700be67099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1f232c720f5a4108a46e79700be67099"}]}] Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 1f232c720f5a4108a46e79700be67099 Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-DeleteServersTestJSON-1717115575-project Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 19a53d1e1a84408ea1dc2aba24bd8299 Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-DeleteServersTestJSON-1717115575-project Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.923016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'server_id': '35f82500-1b55-4e1c-985a-c30b9ed0c0e9'} Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:32:39.923832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:39.925201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:39.926664 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Returning 404 to user: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:32:39.926664 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d5cc76e4-7f0e-4eb5-9b20-a8cb6fe38284 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035867 Sep 01 17:32:39.926664 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 119/223] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:32:39 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:32:40.454055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:40.454686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:40.460668 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:40.461142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:40.461609 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:40.462745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:40.463487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:40.464715 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:40.615523 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:40.623125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4af7409f-a52f-492d-9a80-4517ab290384 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.172927 Sep 01 17:32:40.623675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 105/224] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:40 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:40.704769 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:40.705288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:40.713221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:40.713767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:40.714926 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:40.715630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:40.716077 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:40.716493 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:40.741620 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:32:40.820546 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f3acd4a6-7cff-4de8-af5c-b7a786a0553c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "DELETE /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 204 len: 0 microversion: 2.1 time: 0.118701 Sep 01 17:32:40.821369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 120/225] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:32:40 2022] DELETE /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:32:40.830679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:40.831518 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:40.837648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:40.838399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:40.838762 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:40.840162 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:40.840763 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:40.841520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:40.985227 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:40.993333 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0e7cd912-1c2a-4541-9a41-1f45f879534b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1509 microversion: 2.1 time: 0.166643 Sep 01 17:32:40.994057 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 106/226] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:40 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:41.644699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:41.645707 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:41.651636 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:41.652108 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:41.652531 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:41.653206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:41.653688 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:41.654101 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:41.784913 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:41.793759 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2991c8e9-ce05-4988-824f-de19c23cc8f3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.153319 Sep 01 17:32:41.794331 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 121/227] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:41 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:42.015174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:42.015784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:42.022493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:42.023008 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:42.023874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:42.024559 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:42.025007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:42.025460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:42.044452 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:42.155847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:42.163332 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c514b8f4-7013-4e91-9d76-07dfa0aeb98f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1509 microversion: 2.1 time: 0.152519 Sep 01 17:32:42.163894 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 107/228] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:42 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:42.211006 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:42.211514 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:42.220814 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:42.221439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:42.221946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:42.222713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:42.223241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:42.223672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:42.237891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] HTTP exception thrown: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Request method failure captured: Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: DELETE /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 HTTP/1.1 Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxsSenjnPGkJfCaqeJ3GySl1NFeN3x_uDTMx73zdi4IMIGkPwsb2P6sQT0y7MqvTsjA79PVLTC3uLpMO3y_UvvWcvYPuGcw520x77aZT6XsVm3kabcPa3dNYNo8zg0slg4OOijQ06GU1gS0-q5FwnEvT15V_u8ihREjwqHDbwTLdUg Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 1f232c720f5a4108a46e79700be67099 Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:32:42.240206 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_1f232c720f5a4108a46e79700be67099", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1f232c720f5a4108a46e79700be67099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/1f232c720f5a4108a46e79700be67099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1f232c720f5a4108a46e79700be67099"}]}] Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 1f232c720f5a4108a46e79700be67099 Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-DeleteServersTestJSON-1717115575-project Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 19a53d1e1a84408ea1dc2aba24bd8299 Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-DeleteServersTestJSON-1717115575-project Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.241698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '35f82500-1b55-4e1c-985a-c30b9ed0c0e9'} Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:32:42.242528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.243959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.245178 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Returning 404 to user: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:32:42.245178 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3f80b429-e9af-4865-827e-5130b04d51cc tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "DELETE /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 404 len: 111 microversion: 2.1 time: 0.035715 Sep 01 17:32:42.245454 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 122/229] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:32:42 2022] DELETE /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:32:42.250514 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:42.251124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] [instance: 35f82500-1b55-4e1c-985a-c30b9ed0c0e9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:42.257062 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:42.257760 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:42.258351 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:42.259041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:42.259494 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:42.259914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:42.275805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] HTTP exception thrown: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Request method failure captured: Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 HTTP/1.1 Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxsSenjnPGkJfCaqeJ3GySl1NFeN3x_uDTMx73zdi4IMIGkPwsb2P6sQT0y7MqvTsjA79PVLTC3uLpMO3y_UvvWcvYPuGcw520x77aZT6XsVm3kabcPa3dNYNo8zg0slg4OOijQ06GU1gS0-q5FwnEvT15V_u8ihREjwqHDbwTLdUg Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 1f232c720f5a4108a46e79700be67099 Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:32:42.277953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_1f232c720f5a4108a46e79700be67099", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1f232c720f5a4108a46e79700be67099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/1f232c720f5a4108a46e79700be67099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/1f232c720f5a4108a46e79700be67099"}]}] Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 1f232c720f5a4108a46e79700be67099 Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-DeleteServersTestJSON-1717115575 Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-DeleteServersTestJSON-1717115575-project Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 19a53d1e1a84408ea1dc2aba24bd8299 Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-DeleteServersTestJSON-1717115575-project Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.279133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '35f82500-1b55-4e1c-985a-c30b9ed0c0e9'} Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:32:42.279778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. Sep 01 17:32:42.280877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:32:42.281915 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] Returning 404 to user: Instance 35f82500-1b55-4e1c-985a-c30b9ed0c0e9 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:32:42.281915 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8552e1ee-8b3c-4aea-8f36-cb64115ae716 tempest-DeleteServersTestJSON-1717115575 tempest-DeleteServersTestJSON-1717115575-project] 10.222.0.102 "GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9" status: 404 len: 111 microversion: 2.1 time: 0.032845 Sep 01 17:32:42.281915 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 108/230] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:42 2022] GET /compute/v2.1/servers/35f82500-1b55-4e1c-985a-c30b9ed0c0e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:32:42.814986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:42.816354 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:42.822384 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:42.822865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:42.823304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:42.824565 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:42.825023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:42.825476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:43.059184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:43.066999 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-41c318b3-e800-4ad7-ad77-ed49e8829fd9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.255876 Sep 01 17:32:43.067563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 123/231] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:42 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:43.184063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:43.184787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:43.190752 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:43.191169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:43.191602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:43.192286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:43.192736 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:43.193151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:43.325695 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:43.334115 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-bb5b6289-002b-45d6-84ef-58e1bb93b20a tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1509 microversion: 2.1 time: 0.153928 Sep 01 17:32:43.334923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 109/232] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:43 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:44.088050 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:44.090205 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:44.099494 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:44.100293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:44.100869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:44.101747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:44.102404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:44.102899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:44.346631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:44.357986 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:44.359317 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:44.374210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-808ad4f2-e9cd-4033-a032-2e3e583dc1d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.285574 Sep 01 17:32:44.374597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:44.375756 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:44.389449 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:44.389631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 124/233] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:44 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:44.389731 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:44.389933 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:44.390711 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:44.636273 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:44.652422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-79cbfeea-edae-4505-a4a3-ccc85c0fc25d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1509 microversion: 2.1 time: 0.300585 Sep 01 17:32:44.666638 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 110/234] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:44 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:44.722613 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-29559144-cecc-4db8-847f-d7bae418247f req-6f2a8764-7d01-42ce-b4cd-e8cccef8d40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7db1aa-13fc-4583-ad20-ca91054be971", "name": "network-vif-deleted", "tag": "d1df7c81-a1ca-46b7-a600-d567e4b689e3"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:44.733733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-29559144-cecc-4db8-847f-d7bae418247f req-6f2a8764-7d01-42ce-b4cd-e8cccef8d40f service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:44.734428 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-29559144-cecc-4db8-847f-d7bae418247f req-6f2a8764-7d01-42ce-b4cd-e8cccef8d40f service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:44.734985 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-29559144-cecc-4db8-847f-d7bae418247f req-6f2a8764-7d01-42ce-b4cd-e8cccef8d40f service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:44.748959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-29559144-cecc-4db8-847f-d7bae418247f req-6f2a8764-7d01-42ce-b4cd-e8cccef8d40f service nova] Creating event network-vif-deleted:d1df7c81-a1ca-46b7-a600-d567e4b689e3 for instance fd7db1aa-13fc-4583-ad20-ca91054be971 on hv-cinder-85221 Sep 01 17:32:44.754233 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-29559144-cecc-4db8-847f-d7bae418247f req-6f2a8764-7d01-42ce-b4cd-e8cccef8d40f service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035929 Sep 01 17:32:44.756037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 125/235] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:32:45.397196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:45.397970 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:45.404491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:45.405265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:45.405827 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:45.406879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:45.407395 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:45.407879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:45.676553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:45.677448 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:45.686503 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:45.688327 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:45.689703 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:45.690800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:45.691781 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:45.695671 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:45.705884 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:45.706370 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-bea4ab3e-ed20-4b1f-bc92-a1151dc7e2ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.312740 Sep 01 17:32:45.707444 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 111/236] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:45 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:45.753410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:45.754308 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:45.754953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:45.755603 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lazy-loading 'fault' on Instance uuid fd7db1aa-13fc-4583-ad20-ca91054be971 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:32:45.806454 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:45.816913 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a1b8298e-ee5d-462d-a67e-e56c7f0e4ebc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 200 len: 1308 microversion: 2.1 time: 0.144402 Sep 01 17:32:45.817526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 126/237] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:45 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:46.728375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:46.730095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:46.737251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:46.737852 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:46.738347 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:46.739398 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:46.740045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:46.740544 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:46.841553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:46.842167 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: fd7db1aa-13fc-4583-ad20-ca91054be971] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:46.848876 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:46.849612 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:46.850203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:46.850890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:46.851486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:46.852086 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:46.869285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] HTTP exception thrown: Instance fd7db1aa-13fc-4583-ad20-ca91054be971 could not be found. Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Request method failure captured: Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 HTTP/1.1 Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOyf_S_zwke8If6VPb1DSCPsMLUl1HtFSjlxzODsla4Fo2IfuWBo7HuKNreIi_dd9HbZ0XqGy9h4hIm3C-GOdUJffOV8iMuPvV9lIpn0BDlilCDLo8pr3W08yPO_7Z99HFMJCuhJ44BjGpD8Svqq6P99K1eWScbLqZbe_d-IKj1UPSY Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 5f5e7805e6ae4547a767b7b382a78082 Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-VolumesActionsTest-1983495635 Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:32:46.872018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_5f5e7805e6ae4547a767b7b382a78082", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/5f5e7805e6ae4547a767b7b382a78082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/5f5e7805e6ae4547a767b7b382a78082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/5f5e7805e6ae4547a767b7b382a78082"}]}] Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-VolumesActionsTest-1983495635 Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 5f5e7805e6ae4547a767b7b382a78082 Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-VolumesActionsTest-1983495635 Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-VolumesActionsTest-1983495635-project Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: b54b95db13d84fc4b026fdd119cb7ec5 Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-VolumesActionsTest-1983495635-project Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance fd7db1aa-13fc-4583-ad20-ca91054be971 could not be found. Sep 01 17:32:46.873427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'fd7db1aa-13fc-4583-ad20-ca91054be971'} Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd7db1aa-13fc-4583-ad20-ca91054be971 could not be found. Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:32:46.874235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd7db1aa-13fc-4583-ad20-ca91054be971 could not be found. Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd7db1aa-13fc-4583-ad20-ca91054be971 could not be found. Sep 01 17:32:46.876015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:32:46.878401 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Returning 404 to user: Instance fd7db1aa-13fc-4583-ad20-ca91054be971 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:32:46.880025 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-30239357-249d-4d19-b08e-c5f06cadea05 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971" status: 404 len: 111 microversion: 2.1 time: 0.042228 Sep 01 17:32:46.881993 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 127/238] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:46 2022] GET /compute/v2.1/servers/fd7db1aa-13fc-4583-ad20-ca91054be971 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:32:46.910132 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:46.920428 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-58bd9022-f689-486f-b4d8-80d468fff12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.196393 Sep 01 17:32:46.921356 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 112/239] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:46 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:47.020031 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-136319966", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "networks": [{"uuid": "38e58b72-27dd-45af-8473-2e297559f6e2"}]}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:47.084778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] validate_networks() for [('38e58b72-27dd-45af-8473-2e297559f6e2', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:32:47.473359 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:32:47.474138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:32:47.474613 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:32:47.475023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:32:47.475487 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:32:47.486204 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:47.486686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:47.487298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:47.488025 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:47.488478 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:47.489073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:47.502512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:47.509200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Getting quotas for project 5f5e7805e6ae4547a767b7b382a78082. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:32:47.514175 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Getting quotas for user b54b95db13d84fc4b026fdd119cb7ec5 and project 5f5e7805e6ae4547a767b7b382a78082. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:32:47.526135 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:32:47.528484 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:32:47.575708 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7d021ae9-b144-4142-8bfb-28e025288aee tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.559553 Sep 01 17:32:47.576355 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 128/240] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:32:47 2022] POST /compute/v2.1/servers => generated 382 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:32:47.587198 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4114990d-ec93-494a-923a-bd6e660b7714 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:47.587809 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4114990d-ec93-494a-923a-bd6e660b7714 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:47.686999 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4114990d-ec93-494a-923a-bd6e660b7714 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:47.694551 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4114990d-ec93-494a-923a-bd6e660b7714 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1217 microversion: 2.1 time: 0.111348 Sep 01 17:32:47.695689 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 113/241] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:47 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:47.951738 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:47.953606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:47.969049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:47.973731 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:47.975247 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:47.976800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:47.978436 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:47.978869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:48.173164 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:48.186944 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fa6694ca-2c4f-4ae6-a4c9-be63b9267dee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.246669 Sep 01 17:32:48.202501 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 129/242] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:47 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:48.718286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:48.720269 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:48.734428 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:48.736687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:48.738070 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:48.739754 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:48.741183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:48.745660 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:48.817675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:48.825908 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c7707551-6aa2-4713-8c85-cf6c99facc32 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1269 microversion: 2.1 time: 0.113707 Sep 01 17:32:48.827235 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 114/243] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:48 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1269 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:49.208344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:49.208951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:49.222642 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:49.223721 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:49.224335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:49.228228 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:49.228906 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:49.229563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:49.463161 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:49.472391 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-864f138d-69b3-4822-9152-459b3f00914f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.269041 Sep 01 17:32:49.474999 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 130/244] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:49 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:49.859358 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:49.860675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:49.867338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=76 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:49.869666 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:49.870805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:49.871359 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:49.872189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:49.872768 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:49.873288 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:49.978198 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:49.992203 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c1de42bc-b201-4a08-b5d8-3bafb940ae64 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1275 microversion: 2.1 time: 0.146033 Sep 01 17:32:49.993838 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 115/245] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:49 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:50.493722 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:50.494343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:50.511877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:50.516156 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:50.516545 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:50.518854 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:50.519381 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:50.519854 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:50.721584 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:50.743677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0d25a746-55b1-4da5-8717-9fe787c1312f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.253928 Sep 01 17:32:50.755604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 131/246] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:50 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:51.015502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:51.016799 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:51.032836 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:51.038397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:51.041502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:51.046462 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:51.048556 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:51.049212 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:51.388048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:51.399837 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-395f362f-4eda-4ad3-bc1f-05cc35b1bbd4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.387995 Sep 01 17:32:51.400438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 116/247] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:51 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:51.561980 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-f1a0fc01-89db-4d06-8781-6712594d06a2 req-a7f88972-9bb3-42d2-baad-c1293c04b2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9", "tag": "1b57bbbb-a7f9-479a-a691-02056e34feeb"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:51.588600 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f1a0fc01-89db-4d06-8781-6712594d06a2 req-a7f88972-9bb3-42d2-baad-c1293c04b2f5 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:51.593093 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f1a0fc01-89db-4d06-8781-6712594d06a2 req-a7f88972-9bb3-42d2-baad-c1293c04b2f5 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:51.593405 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f1a0fc01-89db-4d06-8781-6712594d06a2 req-a7f88972-9bb3-42d2-baad-c1293c04b2f5 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:51.637151 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-f1a0fc01-89db-4d06-8781-6712594d06a2 req-a7f88972-9bb3-42d2-baad-c1293c04b2f5 service nova] Creating event network-changed:1b57bbbb-a7f9-479a-a691-02056e34feeb for instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 on hv-cinder-85221 Sep 01 17:32:51.650522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-f1a0fc01-89db-4d06-8781-6712594d06a2 req-a7f88972-9bb3-42d2-baad-c1293c04b2f5 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091812 Sep 01 17:32:51.652179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 132/248] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:32:51.776862 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:51.777383 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:51.786223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:51.787427 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:51.788053 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:51.788951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:51.789568 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:51.790675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:52.058016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:52.071841 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1e714f43-1dc1-45e8-a57f-8c08374f97ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.298028 Sep 01 17:32:52.072533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 117/249] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:51 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:52.422252 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:52.423116 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:52.432881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:52.433388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:52.436404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:52.443179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:52.443916 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:52.444576 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:52.664520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:52.673569 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5893e5ba-8d34-4b3e-92b3-62fcb522f7e7 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.256593 Sep 01 17:32:52.674238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 133/250] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:52 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:53.097297 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:53.097946 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:53.106174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:53.106655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:53.107103 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:53.107774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:53.108250 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:53.108749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:53.290169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:53.300500 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-60d128be-3115-476c-a7c6-68806f13ee75 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.210830 Sep 01 17:32:53.301103 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 118/251] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:53 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:53.413022 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-bd8836ee-e73e-4b91-bf1e-f4e4598d617a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'create', calling method: .version_select at 0x7fb856808430>, body: {"keypair": {"name": "tempest-keypair-1823764669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfeYqmTW1VsosalnPglgWdlXLZ9e160VnKrJ5ww0rSzOdI4nvDYT45Db2ltOuIWBqGB0fc46pZq2wQgTTZIMtOJLqLijopkUd/qavcyGpEfoREyOAKhixtFAyr3DggQlw=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:53.429491 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-bd8836ee-e73e-4b91-bf1e-f4e4598d617a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Getting quotas for project 19bb1cbe315441258828677997dd6fdf. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:32:53.434052 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-bd8836ee-e73e-4b91-bf1e-f4e4598d617a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Getting quotas for user ae0aab3e503249d49ff9473b4990ff63 and project 19bb1cbe315441258828677997dd6fdf. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:32:53.459112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-bd8836ee-e73e-4b91-bf1e-f4e4598d617a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.198422 Sep 01 17:32:53.459702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 134/252] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:32:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:32:53.710003 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:53.715787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:53.722512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:53.723312 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:53.723857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:53.724628 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:53.725160 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:53.725679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:53.921789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:53.929884 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4c256346-218c-4ef8-bdc2-c1f3fb2aee94 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.237585 Sep 01 17:32:53.930457 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 119/253] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:53 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:54.322387 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:54.324137 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:54.339689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:54.341195 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:54.341685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:54.342424 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:54.342889 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:54.343775 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:54.594352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:54.603633 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-66e5eac5-582a-4746-a048-618281746a26 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.285517 Sep 01 17:32:54.604704 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 135/254] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:54 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:54.953173 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:54.954132 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:54.964206 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:54.964693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:54.965373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:54.966279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:54.966873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:54.967498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:55.228475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:55.239251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4772ca9c-33fb-4157-8207-84aa04ade9fa tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.293507 Sep 01 17:32:55.241235 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 120/255] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:54 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:55.496382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-82958637", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95c61e6e-7ee9-458f-a829-4d93850ed5e5"}], "security_groups": [{"name": "tempest-securitygroup--2077824590"}], "key_name": "tempest-keypair-1823764669", "user_data": "}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:55.630874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:55.631485 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:55.645849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:55.646348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:55.646810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:55.647513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:55.647971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:55.648386 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:55.675221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] validate_networks() for [('95c61e6e-7ee9-458f-a829-4d93850ed5e5', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:32:55.945429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:55.960471 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7d99ebf7-e39e-482e-9598-c633f272f45a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.335519 Sep 01 17:32:55.961107 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 121/256] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:55 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:56.263812 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:56.264647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:56.271579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:56.272232 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:56.272950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:56.274401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:56.275100 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:56.275727 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:56.451072 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:32:56.451500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:32:56.451967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:32:56.452433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:32:56.452843 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:32:56.467448 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:56.467923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:56.471110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:56.472062 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:56.473064 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:56.475143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:56.517482 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:56.527511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c0e35fb1-2e89-4c10-9a55-323c29879822 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.268620 Sep 01 17:32:56.528693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 122/257] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:56 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:56.529604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Getting quotas for project 19bb1cbe315441258828677997dd6fdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:32:56.540875 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Getting quotas for user ae0aab3e503249d49ff9473b4990ff63 and project 19bb1cbe315441258828677997dd6fdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:32:56.556470 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:32:56.559179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:32:56.609298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-4a876253-c0cf-49a3-9ac8-275312556621 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.117499 Sep 01 17:32:56.609968 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 136/258] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:32:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 01 17:32:56.620765 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-268ba3e4-405b-4aa9-acf3-dc7dfd44e81b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:56.621405 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-268ba3e4-405b-4aa9-acf3-dc7dfd44e81b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:56.702464 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-268ba3e4-405b-4aa9-acf3-dc7dfd44e81b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:56.709371 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-268ba3e4-405b-4aa9-acf3-dc7dfd44e81b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1240 microversion: 2.1 time: 0.092362 Sep 01 17:32:56.710099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 123/259] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:56 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:56.983366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:56.983978 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:57.000835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:57.001363 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:57.001807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:57.002515 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:57.002970 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:57.003395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:57.201011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:57.210170 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3c470627-5689-460d-846c-748d307d3e68 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.230642 Sep 01 17:32:57.210846 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 137/260] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:56 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:57.550561 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:57.551301 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:57.558731 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:57.559217 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:57.559646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:57.560346 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:57.560814 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:57.561201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:57.716029 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:57.730665 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-99222131-2d41-4bac-bcd0-bd6b517f177b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.185820 Sep 01 17:32:57.731067 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:57.731526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 124/261] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:57 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:57.731680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:57.738789 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:57.739265 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:57.739699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:57.740390 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:57.741017 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:57.741468 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:57.808029 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:57.819543 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a439de77-1717-4052-bdb1-639fde96ddf9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1292 microversion: 2.1 time: 0.092603 Sep 01 17:32:57.820667 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 138/262] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:57 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:58.231420 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:58.232021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:58.237909 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:58.238377 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:58.238801 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:58.239472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:58.239913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:58.240309 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:58.379981 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:58.390788 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1bc505a0-74ca-4224-94c9-907e1c975961 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.163625 Sep 01 17:32:58.406663 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 125/263] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:58 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:58.708203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-57d6447c-dfde-48f3-ba58-5bb2e4db6b9d req-04b49d2e-295e-46ff-8b7c-e6fc597fe74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9", "name": "network-vif-plugged", "status": "completed", "tag": "1b57bbbb-a7f9-479a-a691-02056e34feeb"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:32:58.718787 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-57d6447c-dfde-48f3-ba58-5bb2e4db6b9d req-04b49d2e-295e-46ff-8b7c-e6fc597fe74d service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:58.719504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-57d6447c-dfde-48f3-ba58-5bb2e4db6b9d req-04b49d2e-295e-46ff-8b7c-e6fc597fe74d service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:58.720927 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-57d6447c-dfde-48f3-ba58-5bb2e4db6b9d req-04b49d2e-295e-46ff-8b7c-e6fc597fe74d service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:58.732619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-57d6447c-dfde-48f3-ba58-5bb2e4db6b9d req-04b49d2e-295e-46ff-8b7c-e6fc597fe74d service nova] Creating event network-vif-plugged:1b57bbbb-a7f9-479a-a691-02056e34feeb for instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 on hv-cinder-85221 Sep 01 17:32:58.739246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-57d6447c-dfde-48f3-ba58-5bb2e4db6b9d req-04b49d2e-295e-46ff-8b7c-e6fc597fe74d service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034514 Sep 01 17:32:58.739737 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 139/264] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:32:58.753494 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:58.755047 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:58.762409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:58.763185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:58.763834 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:58.771279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:58.773476 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:58.774298 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:58.841272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:58.842027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:58.848973 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:58.849489 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:58.849910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:58.850693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:58.851197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:58.851710 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:58.856243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:58.919412 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:58.926946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c716af35-56f0-4780-ac16-de16fb2d8a40 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1298 microversion: 2.1 time: 0.090701 Sep 01 17:32:58.927506 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 140/265] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:58 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:32:59.203824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:59.207985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:32:59.216017 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-510cf7cc-eafc-4000-a1c5-93816693b84f tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.466281 Sep 01 17:32:59.230035 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 126/266] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:58 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:59.420567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:59.421369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:59.427783 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:59.428353 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:59.428804 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:59.429555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:59.430021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:59.430419 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:59.581566 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:32:59.589964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a58e73d3-1617-4c6d-8923-d3b2f8495b22 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.173930 Sep 01 17:32:59.590634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 141/267] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:59 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:32:59.947901 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:32:59.948647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:32:59.956058 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:59.956538 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:59.956961 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:32:59.957704 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:32:59.958149 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:32:59.958563 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:00.090423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:00.098403 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-676ef733-a749-4ecb-9999-a2af63935b7e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.154708 Sep 01 17:33:00.098895 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 127/268] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:32:59 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:00.238385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:00.238988 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:00.246083 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:00.246568 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:00.247000 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:00.247670 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:00.248171 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:00.248561 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:00.512932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:00.520661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7c865c67-c7a9-4651-897f-641ba0e88740 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.286059 Sep 01 17:33:00.521219 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 142/269] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:00 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:00.610940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:00.611574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:00.617432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:00.617909 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:00.618335 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:00.619009 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:00.619460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:00.619876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:00.742444 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:00.750126 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d8b6dfa6-cc63-4df2-bb7d-e969e71bc991 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.143003 Sep 01 17:33:00.750689 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 128/270] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:00 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:01.118963 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:01.119567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:01.130983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:01.131471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:01.131908 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:01.132598 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:01.133049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:01.133651 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:01.262184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:01.270152 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-533c10c5-c715-4c99-97b6-eca86965638c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.155231 Sep 01 17:33:01.270751 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 143/271] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:01 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:01.541371 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:01.541906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:01.547756 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:01.548227 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:01.548646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:01.549335 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:01.549777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:01.550189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:01.675808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:01.683957 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9e3948e8-9115-4d57-bd56-807971cd5928 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.146558 Sep 01 17:33:01.684535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 129/272] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:01 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:01.770659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:01.771433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:01.777425 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:01.777905 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:01.778356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:01.779020 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:01.779466 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:01.779884 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:01.913351 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:01.921464 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c951af00-aa22-4ef7-9087-6140a87c9402 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.154683 Sep 01 17:33:01.922151 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 144/273] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:01 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:02.291886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:02.292487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:02.298445 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:02.298951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:02.299378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:02.300058 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:02.300501 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:02.300917 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:02.427975 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:02.435495 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e042a350-d811-4f7e-add1-c69d3933d651 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.148049 Sep 01 17:33:02.436048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 130/274] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:02 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:02.704063 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:02.704663 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:02.711016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:02.711486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:02.711914 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:02.712588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:02.713684 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:02.714097 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:02.843943 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:02.852263 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d1ce4a1f-da00-42bc-88b9-29765946fff0 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.151942 Sep 01 17:33:02.852831 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 145/275] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:02 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:02.942579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:02.943181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:02.950089 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:02.950690 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:02.951115 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:02.951797 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:02.952242 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:02.952653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:03.077422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:03.084899 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-056d1b0f-cea3-411c-b22c-2649bb221d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.146140 Sep 01 17:33:03.085475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 131/276] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:02 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:03.455859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:03.456478 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:03.462531 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:03.463032 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:03.463465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:03.464150 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:03.464606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:03.465028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:03.589427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:03.597349 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0282349e-bf93-47aa-88d6-7916638202d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.145334 Sep 01 17:33:03.597909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 146/277] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:03 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:03.872119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:03.872728 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:03.878824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:03.879305 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:03.879736 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:03.880445 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:03.880880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:03.881299 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:04.011635 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:04.019316 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5d001283-e028-41ed-95ba-f37c4ef18d08 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.151233 Sep 01 17:33:04.019867 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 132/278] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:03 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:04.105487 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:04.106023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:04.112312 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:04.112782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:04.113208 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:04.113908 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:04.114352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:04.114764 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:04.240799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:04.248458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ee21807e-3bb1-417c-b68a-849bce881232 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.146919 Sep 01 17:33:04.249001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 147/279] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:04 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:04.618418 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:04.619065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:04.625599 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:04.626078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:04.626535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:04.627204 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:04.627663 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:04.628074 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:04.784260 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:04.792858 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3a4df4cf-d90e-4ec5-bd92-b47cfe4d100e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.178153 Sep 01 17:33:04.793698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 133/280] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:04 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:05.041051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:05.042179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:05.049264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:05.051699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:05.052350 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:05.053219 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:05.054119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:05.055072 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:05.262982 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:05.271082 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:05.273080 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:05.273652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5c2dbe2d-456d-49eb-a691-d4f76c800043 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.236296 Sep 01 17:33:05.275645 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 148/281] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:05 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:05.281832 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:05.283120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:05.283707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:05.284654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:05.286973 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:05.287330 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:05.462155 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-e658ebdb-f93e-4aa3-9bc7-73b8162fe458 req-b9c77fc5-e85e-42c3-92ec-f0cf6f6fd620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14064865-1bc2-4b27-993b-cd5e726de947", "tag": "e42b846f-2457-41ca-a620-122194a4dfd4"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:33:05.482103 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-e658ebdb-f93e-4aa3-9bc7-73b8162fe458 req-b9c77fc5-e85e-42c3-92ec-f0cf6f6fd620 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:05.482589 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-e658ebdb-f93e-4aa3-9bc7-73b8162fe458 req-b9c77fc5-e85e-42c3-92ec-f0cf6f6fd620 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:05.489191 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-e658ebdb-f93e-4aa3-9bc7-73b8162fe458 req-b9c77fc5-e85e-42c3-92ec-f0cf6f6fd620 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:05.509688 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-e658ebdb-f93e-4aa3-9bc7-73b8162fe458 req-b9c77fc5-e85e-42c3-92ec-f0cf6f6fd620 service nova] Creating event network-changed:e42b846f-2457-41ca-a620-122194a4dfd4 for instance 14064865-1bc2-4b27-993b-cd5e726de947 on hv-cinder-85221 Sep 01 17:33:05.519299 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-e658ebdb-f93e-4aa3-9bc7-73b8162fe458 req-b9c77fc5-e85e-42c3-92ec-f0cf6f6fd620 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061336 Sep 01 17:33:05.520708 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 149/282] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:33:05.523660 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:05.532681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1dc79c06-ba5a-4778-adf7-d52a0129fe79 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.265612 Sep 01 17:33:05.555236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 134/283] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:05 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:05.814326 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:05.815336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:05.823863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:05.824592 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:05.825376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:05.826466 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:05.828123 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:05.829532 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:06.002504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:06.011247 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-75166e07-48ee-43dc-b146-59bd87f1396b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.201046 Sep 01 17:33:06.011916 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 150/284] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:05 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:06.295913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:06.296764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:06.302996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:06.303502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:06.303923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:06.304597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:06.305041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:06.305519 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:06.441095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:06.449344 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-aecb5071-04e4-474d-8f3a-b8ddd9edc7e6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1317 microversion: 2.1 time: 0.157280 Sep 01 17:33:06.449907 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 135/285] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:06 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:06.556290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:06.557165 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:06.563973 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=4 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:06.564411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=16 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:06.566312 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:06.567278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:06.567946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:06.568506 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:06.572928 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:06.573398 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:06.761337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:06.769854 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-59160fa7-85ed-4274-8850-0d7c6c637bc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.217534 Sep 01 17:33:06.770768 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 151/286] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:06 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:07.032342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:07.032954 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:07.035766 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=4 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:07.040167 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:07.040732 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:07.041283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:07.042065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:07.042587 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:07.043080 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:07.180211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:07.188025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c0d19a5e-1475-40ee-8fdf-03519a8b85f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.159539 Sep 01 17:33:07.188590 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 136/287] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:07 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:07.471624 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:07.472405 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:07.478789 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:07.479272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:07.479727 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:07.480686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:07.481143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:07.481594 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:07.621439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:07.629021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-89b84200-e05a-47e8-af72-ebfab3619be6 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1502 microversion: 2.1 time: 0.161883 Sep 01 17:33:07.629936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 152/288] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:07 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:07.790953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:07.791600 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:07.797604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:07.798088 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:07.798521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:07.799251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:07.799705 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:07.800124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:07.947750 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:07.962431 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-41df2679-80b2-4068-aaa9-bd1bc6e45e11 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.174933 Sep 01 17:33:07.964569 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 137/289] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:07 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:08.208928 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:08.209571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:08.215865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:08.216593 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:08.217026 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:08.217741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:08.218193 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:08.218613 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:08.296281 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:08.296779 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:08.303122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:08.303612 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:08.304185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:08.304878 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:08.305532 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:08.305954 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:08.331863 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Going to try to terminate instance {{(pid=121745) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:33:08.374308 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:08.382816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-59edb243-8371-4c02-a311-40278dfdb41e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.177704 Sep 01 17:33:08.383399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 153/290] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:08 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:08.444392 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7541967c-db1f-440f-a576-62dadbb97a95 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "DELETE /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 204 len: 0 microversion: 2.1 time: 0.151868 Sep 01 17:33:08.445055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 138/291] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:33:08 2022] DELETE /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:33:08.454191 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:08.454917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:08.461195 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:08.461730 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:08.462235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:08.463029 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:08.463554 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:08.464042 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:08.867540 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:08.879766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-4f914591-e9e1-4dd3-a11e-17cf5386acf2 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.429904 Sep 01 17:33:08.880344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 154/292] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:08 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:08.986110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:08.986707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:08.993273 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:08.993786 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:08.994213 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:08.994898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:08.995346 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:08.995765 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:09.132198 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:09.141355 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-04faeea3-78d0-45c9-b710-0c2d9952086e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.159390 Sep 01 17:33:09.141926 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 139/293] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:08 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:09.404763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:09.405411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:09.411387 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:09.411873 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:09.412308 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:09.412998 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:09.413498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:09.413926 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:09.547707 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:09.555332 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d301953c-e14c-40d6-b05c-980f6d241369 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.155373 Sep 01 17:33:09.555893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 155/294] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:09 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:09.900592 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:09.901200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:09.907289 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:09.907775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:09.908208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:09.908896 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:09.909370 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:09.909791 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:10.057214 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:10.065081 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0b831c02-c1ee-4dc1-8eed-8c347167826d tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.168559 Sep 01 17:33:10.065681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 140/295] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:09 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:10.163407 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:10.164018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:10.171008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:10.171492 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:10.171921 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:10.172601 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:10.173049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:10.173503 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:10.307848 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:10.316587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-66361cce-2012-4333-a996-b0c12e1d72f6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.157016 Sep 01 17:33:10.317166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 156/296] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:10 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:10.576327 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:10.576932 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:10.582768 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:10.583247 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:10.583678 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:10.584354 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:10.584805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:10.585225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:10.717407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:10.721172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:10.726258 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-47958620-2a0b-403b-ad1e-aee78c5597da tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.153790 Sep 01 17:33:10.726813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 141/297] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:10 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:11.087136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:11.087837 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:11.094470 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:11.094945 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:11.095369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:11.096042 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:11.096491 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:11.096904 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:11.114317 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:11.225057 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:11.232765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a7c6adc4-b27f-44a4-a9a5-9c7a596c8541 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.149428 Sep 01 17:33:11.233335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 157/298] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:11 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:11.337810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:11.338420 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:11.346456 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:11.346939 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:11.347371 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:11.348178 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:11.348634 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:11.349085 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:11.477563 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:11.487425 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fd7f5f24-767a-4ebd-bb13-3ea76936a51c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.153234 Sep 01 17:33:11.488273 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 142/299] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:11 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:11.747382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:11.747914 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:11.753848 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:11.754328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:11.754761 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:11.755439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:11.755888 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:11.756302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:11.885038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:11.892972 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d14bde14-6310-4641-9872-7435825a45a9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.150070 Sep 01 17:33:11.893608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 158/300] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:11 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:12.253050 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:12.253680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:12.259738 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:12.260211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:12.260709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:12.261415 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:12.261864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:12.262277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:12.395408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:12.403025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b09acf36-e468-46fd-b1a5-ddd9e4841f2b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.153854 Sep 01 17:33:12.403594 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 143/301] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:12 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:12.516207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:12.516823 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:12.522699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:12.523182 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:12.523641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:12.524324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:12.524778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:12.525714 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:12.651043 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:12.658683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5fe504c2-04b7-429b-a3d6-d8d818cc5f4d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.146322 Sep 01 17:33:12.659235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 159/302] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:12 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:12.914563 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:12.915166 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:12.921727 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:12.922204 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:12.922635 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:12.923312 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:12.923765 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:12.924187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:13.053014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:13.061098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b0842076-9f10-4ed0-8456-64c68b607a8d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.150421 Sep 01 17:33:13.061692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 144/303] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:12 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:13.424130 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:13.424820 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:13.427124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:13.433330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:13.433739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:13.434203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:13.434880 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:13.435322 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:13.435735 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:13.563999 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:13.571692 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-19733f9b-f782-47f8-933d-ebf586c1bdb9 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.151375 Sep 01 17:33:13.572839 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 160/304] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:13 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:13.678874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:13.679481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:13.686184 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:13.686603 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:13.687030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:13.687703 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:13.688152 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:13.688562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:13.812038 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:13.819783 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-465abc14-fbb5-433e-a6b2-69c9cfaee2ed tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.144710 Sep 01 17:33:13.820338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 145/305] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:13 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:14.082235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:14.082876 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:14.089266 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:14.089784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:14.090219 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:14.090903 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:14.091352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:14.091769 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:14.219742 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:14.227346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-400d86f1-2165-4ff7-acea-3eb560aeb8b0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.148995 Sep 01 17:33:14.227932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 161/306] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:14 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:14.591860 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:14.592395 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:14.598531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:14.599004 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:14.599430 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:14.600105 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:14.600552 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:14.600965 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:14.724133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:14.732482 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4761148b-dc05-4772-b568-5eaedb9b81db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.144503 Sep 01 17:33:14.733052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 146/307] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:14 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:14.839902 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:14.840537 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:14.847309 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:14.847725 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:14.848154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:14.848837 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:14.849287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:14.849733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:14.976183 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:14.984421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e35ee53f-7aad-43d6-853a-e4f47dda8282 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.148949 Sep 01 17:33:14.984978 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 162/308] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:14 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:15.247869 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:15.248393 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:15.254330 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:15.254811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:15.255242 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:15.255923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:15.256374 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:15.256792 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:15.386648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:15.394227 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5d1b023c-e902-4b07-9473-5a9174818c87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.150359 Sep 01 17:33:15.394774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 147/309] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:15 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:15.753722 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:15.754321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:15.760833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:15.761319 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:15.761753 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:15.762424 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:15.762866 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:15.763279 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:15.892697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:15.900469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-44fec2ac-88bc-413e-aa78-c739e5b6b5b1 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.150559 Sep 01 17:33:15.901024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 163/310] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:15 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:16.004430 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:16.005032 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:16.011852 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:16.012663 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:16.013144 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:16.013996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:16.014474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:16.014887 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:16.138745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:16.146438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0d559866-c722-4200-aacf-1f4bc607df41 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.145867 Sep 01 17:33:16.146990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 148/311] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:15 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:16.415128 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:16.416335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:16.422241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:16.422728 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:16.423164 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:16.423846 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:16.424298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:16.424716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:16.551787 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:16.559932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-361a74ee-ffdf-462d-8929-45f834f73e05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.148560 Sep 01 17:33:16.560492 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 164/312] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:16 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:16.921594 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:16.922128 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:16.927991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:16.928465 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:16.928893 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:16.929600 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:16.930053 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:16.930463 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:17.058659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:17.066450 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e6b1fe37-e788-41a7-845b-7f0b38fd57f4 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.148808 Sep 01 17:33:17.067005 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 149/313] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:16 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:17.167062 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:17.167670 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:17.174333 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:17.174739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:17.175174 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:17.175873 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:17.176325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:17.176749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:17.318471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:17.326547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d2815907-c980-4bce-9762-b276b0b71fdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.163504 Sep 01 17:33:17.327094 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 165/314] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:17 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:33:17.580404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:17.581011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:17.586981 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:17.587459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:17.587888 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:17.588562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:17.589010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:17.589454 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:17.713504 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:17.721246 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5d80c469-fce1-4c05-8848-2c536ea09c5d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.144655 Sep 01 17:33:17.721824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 150/315] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:17 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:18.086982 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:18.088256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:18.094462 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:18.094942 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:18.095373 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:18.096058 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:18.096510 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:18.096931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:18.225951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:18.233633 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-882a09a0-e7ba-4118-86bc-c2e6180879dc tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.150519 Sep 01 17:33:18.234189 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 166/316] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:18 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:18.348068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:18.348643 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:18.355268 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:18.355741 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:18.356167 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:18.356844 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:18.357292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:18.357734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:18.485153 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:18.492871 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-01f06cb1-64fa-42ec-b5e2-932318f893b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.148982 Sep 01 17:33:18.493958 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 151/317] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:18 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:18.742249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:18.742778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:18.749318 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:18.749822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:18.750257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:18.750942 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:18.751393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:18.751813 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:18.879934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:18.887556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-80ab6cd7-c7c7-4c0e-be4a-c2e93990f07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.149341 Sep 01 17:33:18.888122 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 167/318] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:18 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:19.254844 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:19.255447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:19.262001 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:19.262474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:19.262902 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:19.263575 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:19.264023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:19.264444 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:19.392959 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:19.400498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-74f18326-fa58-45df-8954-37438da5d83e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.149599 Sep 01 17:33:19.401047 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 152/319] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:19 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:19.514080 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:19.514674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:19.521288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:19.521789 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:19.522223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:19.522907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:19.523357 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:19.523779 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:19.652611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:19.660475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0b3aa7e2-94d4-492a-a387-33f048b57237 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.150295 Sep 01 17:33:19.661034 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 168/320] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:19 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:19.908036 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:19.908637 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:19.910454 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:19.916174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:19.916643 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:19.917063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:19.917774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:19.918213 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:19.918626 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:20.043646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:20.051224 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a476e897-ec71-4f57-a05c-15e2ba4e0d8f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.147110 Sep 01 17:33:20.051766 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 153/321] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:19 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:20.421237 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:20.421862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:20.428118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:20.428595 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:20.429046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:20.429763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:20.430208 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:20.430625 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:20.559237 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:20.567266 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f5d8cf67-566e-4b8a-95aa-3562cb13f901 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.149893 Sep 01 17:33:20.567821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 169/322] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:20 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:20.681611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:20.682149 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:20.688018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:20.688494 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:20.688954 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:20.689658 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:20.690109 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:20.690521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:20.822393 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:20.830585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fe661a6f-59fa-4f31-bbc8-c34ce3e38c4f tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.153309 Sep 01 17:33:20.831142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 154/323] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:20 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:21.071783 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:21.072389 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:21.078513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:21.079003 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:21.079427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:21.080101 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:21.080548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:21.080962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:21.213261 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:21.221136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ecade561-856d-47e7-87c9-447eeee7db1f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.153199 Sep 01 17:33:21.221716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 170/324] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:21 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:21.588523 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:21.589155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:21.595601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:21.596083 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:21.596514 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:21.597199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:21.597679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:21.598097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:21.732704 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:21.741477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8c5b7f7c-c699-4ffa-a1fe-db5a0197b606 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.156692 Sep 01 17:33:21.742053 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 155/325] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:21 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:21.851526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:21.852145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:21.859263 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:21.859740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:21.860172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:21.860861 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:21.861339 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:21.861747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:21.988456 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:21.996676 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c3b3bddf-0cf9-4641-8fe4-f726ba3d19ae tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.148929 Sep 01 17:33:21.997214 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 171/326] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:21 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:22.242792 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:22.243363 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:22.249274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:22.249791 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:22.250219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:22.250893 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:22.251340 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:22.251786 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:22.378631 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:22.386568 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7fce160f-988f-4234-97ee-823615f17d26 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.147953 Sep 01 17:33:22.387120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 156/327] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:22 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:22.763925 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:22.764525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:22.770549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:22.771030 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:22.771460 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:22.772151 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:22.772602 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:22.773024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:22.912985 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:22.920705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-da03a349-c506-48e0-bd82-95366dce344b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.160687 Sep 01 17:33:22.921263 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 172/328] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:22 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:23.015830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:23.016432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:23.022304 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:23.022778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:23.023208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:23.023882 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:23.024339 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:23.024753 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:23.152008 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:23.161811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-706447bc-1704-4760-9c68-00689acf8f38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.149339 Sep 01 17:33:23.162859 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 157/329] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:23 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:23.408019 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:23.408547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:23.414475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:23.414954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:23.415382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:23.416060 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:23.416509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:23.416925 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:23.556954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:23.564592 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-afeaccc1-e374-4fc7-a1c6-9bf0c618a0a2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.160511 Sep 01 17:33:23.565150 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 173/330] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:23 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:23.941605 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:23.942211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:23.948125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:23.948599 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:23.949023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:23.949731 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:23.950172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:23.950586 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:23.967976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:24.075429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:24.083201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d6f2834a-9105-42bb-b4fb-440f0659e89e tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.145395 Sep 01 17:33:24.083756 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 158/331] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:23 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:24.185691 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:24.186297 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:24.192640 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:24.193118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:24.193610 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:24.194291 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:24.194741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:24.195157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:24.199009 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:24.321568 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:24.329266 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9087e932-71ae-457a-968f-318f490bf8aa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.147461 Sep 01 17:33:24.329861 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 174/332] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:24 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:24.586218 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:24.586770 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:24.592660 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:24.593131 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:24.593843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:24.594513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:24.594953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:24.595362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:24.721808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:24.729868 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6519e16c-15b2-46aa-8758-a9d423c9006f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.147496 Sep 01 17:33:24.730421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 159/333] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:24 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:25.104078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:25.104713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:25.110661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:25.111136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:25.111564 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:25.112242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:25.112694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:25.113111 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:25.242006 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:25.250413 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-181a37d8-e11f-407f-b693-2fea6da90882 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.150156 Sep 01 17:33:25.250970 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 175/334] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:25 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:25.350264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:25.350905 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:25.357323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:25.357824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:25.358285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:25.358974 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:25.359425 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:25.359843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:25.482967 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:25.490518 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ee650c5b-fd75-401f-bb16-528bc4755ba1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.144174 Sep 01 17:33:25.491071 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 160/335] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:25 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:25.751187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:25.751720 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:25.757665 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:25.758147 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:25.759216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:25.759897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:25.760346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:25.760759 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:25.893810 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:25.901647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6373e5c3-4f67-483d-9150-b5f754548376 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.154099 Sep 01 17:33:25.902203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 176/336] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:25 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:26.272603 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:26.273406 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:26.279246 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:26.279711 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:26.280129 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:26.280795 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:26.281236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:26.281666 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:26.408710 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:26.416719 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-515a405b-52a7-48a4-95b4-13943bce9a4b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.148771 Sep 01 17:33:26.417265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 161/337] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:26 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:26.510877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:26.511421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:26.517826 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:26.518303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:26.518736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:26.519415 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:26.519864 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:26.520285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:26.646156 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:26.654338 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b8432e94-108c-4675-a2fe-587998ee8536 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.147335 Sep 01 17:33:26.654898 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 177/338] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:26 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:26.921976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:26.922583 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:26.928496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:26.928971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:26.929433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:26.930113 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:26.930565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:26.930978 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:27.055525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:27.063077 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a097e38e-c38a-4e59-a2f9-9644c934cf9a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.144974 Sep 01 17:33:27.063563 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 162/339] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:26 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:27.438049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:27.438648 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:27.444548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:27.445021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:27.445487 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:27.446160 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:27.446604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:27.447601 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:27.587790 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:27.595839 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6e39dc9e-8204-4451-af75-4ac8dd8abdea tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.161725 Sep 01 17:33:27.596409 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 178/340] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:27 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:27.674602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:27.675208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:27.681041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:27.682181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:27.682611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:27.683289 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:27.683738 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:27.684156 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:27.815630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:27.823337 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-17c700d0-324d-4a48-8676-e5a9584f5caa tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.152560 Sep 01 17:33:27.823888 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 163/341] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:27 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:28.083694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:28.084296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:28.090760 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:28.091179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:28.091605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:28.092274 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:28.092718 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:28.093133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:28.217280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:28.225018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9fb3cad6-614f-43d2-b0a3-e07f466cb7aa tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.145129 Sep 01 17:33:28.225608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 179/342] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:28 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:28.616917 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:28.617554 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:28.623645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:28.624149 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:28.624600 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:28.625487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:28.625986 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:28.626475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:28.756914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:28.765322 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8f1d2980-f0c9-4790-a7d0-82c411b9d21c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.152342 Sep 01 17:33:28.765889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 164/343] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:28 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:28.845818 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:28.846498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:28.852998 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:28.853509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:28.853938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:28.854635 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:28.855089 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:28.855677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:28.901238 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-0c06727a-1055-4b95-ab60-5b48cbff8f89 req-41bac51b-bb71-4982-94d9-42f54e8b08fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14064865-1bc2-4b27-993b-cd5e726de947", "name": "network-vif-plugged", "status": "completed", "tag": "e42b846f-2457-41ca-a620-122194a4dfd4"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:33:28.919880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-0c06727a-1055-4b95-ab60-5b48cbff8f89 req-41bac51b-bb71-4982-94d9-42f54e8b08fb service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:28.923376 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-0c06727a-1055-4b95-ab60-5b48cbff8f89 req-41bac51b-bb71-4982-94d9-42f54e8b08fb service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:28.923937 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-0c06727a-1055-4b95-ab60-5b48cbff8f89 req-41bac51b-bb71-4982-94d9-42f54e8b08fb service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:29.076774 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:29.085379 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7da1e9a3-edbd-45e2-971d-7d85c1e08269 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.243657 Sep 01 17:33:29.086073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 180/344] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:28 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:29.102199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-0c06727a-1055-4b95-ab60-5b48cbff8f89 req-41bac51b-bb71-4982-94d9-42f54e8b08fb service nova] Creating event network-vif-plugged:e42b846f-2457-41ca-a620-122194a4dfd4 for instance 14064865-1bc2-4b27-993b-cd5e726de947 on hv-cinder-85221 Sep 01 17:33:29.107699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-0c06727a-1055-4b95-ab60-5b48cbff8f89 req-41bac51b-bb71-4982-94d9-42f54e8b08fb service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210222 Sep 01 17:33:29.108435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 165/345] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:33:29.246674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:29.247285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:29.253835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:29.254388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:29.254917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:29.255674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:29.256150 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:29.256567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:29.387824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:29.395530 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-232f8893-fb4c-4440-bd6a-bb300cac1b74 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.153323 Sep 01 17:33:29.396040 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 181/346] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:29 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:29.787111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:29.787745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:29.794496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:29.794972 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:29.795404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:29.796084 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:29.796557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:29.796971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:29.922142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:29.929744 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f4e2e061-1964-467c-b8ee-c06d126fe5af tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.147039 Sep 01 17:33:29.930296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 166/347] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:29 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:30.105534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:30.106161 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:30.113054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:30.113572 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:30.114002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:30.114691 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:30.115141 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:30.115572 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:30.250963 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:30.263573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e29e92b9-0a8c-4ccc-8ab9-270eaceed50b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.161316 Sep 01 17:33:30.264146 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 182/348] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:30 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:30.416177 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:30.416772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:30.423359 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:30.424262 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:30.424697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:30.425410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:30.425930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:30.426520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:30.600096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:30.608404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ef59ea11-9ca2-446d-b6be-8f672c9b33c1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.196104 Sep 01 17:33:30.608948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 167/349] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:30 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:30.950687 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:30.951197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:30.957447 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:30.957940 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:30.958372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:30.959072 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:30.959525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:30.959945 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:31.085831 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:31.094350 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b0e5c0e3-79e4-4959-af71-ae7d87a3804b tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.147775 Sep 01 17:33:31.094909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 183/350] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:30 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:31.284784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:31.285411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:31.291760 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:31.292234 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:31.292839 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:31.293509 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:31.293953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:31.294364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:31.419992 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:31.427570 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e8aae19b-ccb2-4548-b4ae-0efd98724cca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.146908 Sep 01 17:33:31.428118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 168/351] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:31 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:31.630288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:31.630898 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:31.637803 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:31.638287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:31.638722 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:31.639415 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:31.639870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:31.640290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:31.769814 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:31.777499 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-be8a2a4f-2bd0-4e85-8a82-011e1da73b0c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.151052 Sep 01 17:33:31.778051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 184/352] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:31 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:32.115499 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:32.116109 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:32.122749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:32.123231 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:32.123661 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:32.124339 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:32.124791 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:32.125209 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:32.255698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:32.263350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-17419ad7-e465-4464-94d7-b8ece713cf83 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.151701 Sep 01 17:33:32.263906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 169/353] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:32 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:32.447229 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:32.447763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:32.453660 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:32.454130 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:32.454556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:32.455228 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:32.455672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:32.456085 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:32.583540 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:32.591573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6c34662f-cf0d-47b7-8b93-d55bd541c92a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.148370 Sep 01 17:33:32.592126 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 185/354] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:32 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:32.797925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:32.798567 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:32.804489 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:32.804966 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:32.805422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:32.806101 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:32.806550 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:32.806963 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:32.933559 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:32.941099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3194e317-470b-491e-a9a4-2386f91907fe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.146994 Sep 01 17:33:32.941682 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 170/355] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:32 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:33.284744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:33.285382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:33.291956 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:33.292481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:33.292911 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:33.293659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:33.294107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:33.294520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:33.426687 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:33.434873 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-11fce2f6-2066-4c91-ad38-6a201504b442 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.154379 Sep 01 17:33:33.435429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 186/356] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:33 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:33.612304 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:33.612830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:33.619302 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:33.619770 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:33.620193 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:33.620860 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:33.621340 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:33.621736 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:33.749682 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:33.757226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0fc54cf1-08a4-47dd-96a6-18d705a6e008 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.148816 Sep 01 17:33:33.757809 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 171/357] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:33 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:33.962896 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:33.963430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:33.969929 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:33.970409 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:33.970840 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:33.971520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:33.971971 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:33.972388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:34.100313 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:34.109002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e8b0a6d7-a4e6-464c-87e9-e76d493fac33 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.150541 Sep 01 17:33:34.109690 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 187/358] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:33 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:34.122817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-3e2c1f01-71a3-4cfa-8a5c-29bc49256528 req-d2348952-6697-419a-a73a-64dfb0c9142a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9", "name": "network-vif-unplugged", "status": "completed", "tag": "1b57bbbb-a7f9-479a-a691-02056e34feeb"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:33:34.132726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-3e2c1f01-71a3-4cfa-8a5c-29bc49256528 req-d2348952-6697-419a-a73a-64dfb0c9142a service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:34.133326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-3e2c1f01-71a3-4cfa-8a5c-29bc49256528 req-d2348952-6697-419a-a73a-64dfb0c9142a service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:34.133636 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-3e2c1f01-71a3-4cfa-8a5c-29bc49256528 req-d2348952-6697-419a-a73a-64dfb0c9142a service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:34.145520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-3e2c1f01-71a3-4cfa-8a5c-29bc49256528 req-d2348952-6697-419a-a73a-64dfb0c9142a service nova] Creating event network-vif-unplugged:1b57bbbb-a7f9-479a-a691-02056e34feeb for instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 on hv-cinder-85221 Sep 01 17:33:34.151141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-3e2c1f01-71a3-4cfa-8a5c-29bc49256528 req-d2348952-6697-419a-a73a-64dfb0c9142a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031950 Sep 01 17:33:34.151714 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 172/359] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:33:34.455958 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:34.456572 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:34.463611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:34.464089 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:34.464524 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:34.465216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:34.465695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:34.466119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:34.595190 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:34.602862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9654387f-475d-4b39-aea3-da1546f347db tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.150775 Sep 01 17:33:34.603418 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 188/360] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:34 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:34.777899 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:34.778577 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:34.784573 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:34.785041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:34.785494 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:34.786169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:34.786611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:34.787023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:34.917990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:34.925522 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0582224e-2667-4c04-a502-181778cace46 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1525 microversion: 2.1 time: 0.151795 Sep 01 17:33:34.926151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 173/361] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:34 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1525 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:35.130302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:35.130877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:35.137209 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:35.137739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:35.138173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:35.138856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:35.139437 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:35.139928 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:35.265473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:35.273649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-4fad9546-17c9-46a8-b0a3-6a66203509a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.148210 Sep 01 17:33:35.274207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 189/362] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:35 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:35.623498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:35.624116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:35.630202 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:35.630675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:35.631095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:35.631772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:35.632336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:35.633078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:35.768631 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:35.777062 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b87f5947-9554-4e16-9fed-de84b0126c22 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.157464 Sep 01 17:33:35.777654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 174/363] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:35 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:35.945744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:35.947006 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:35.953832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:35.954303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:35.954732 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:35.955412 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:35.955862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:35.956329 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:36.084472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:36.088722 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:36.095241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f3df41f2-f317-4b92-bbba-49f5508bf4b7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1505 microversion: 2.1 time: 0.153327 Sep 01 17:33:36.096000 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 190/364] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:35 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:36.115383 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:36.115987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:36.122084 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:36.122568 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:36.122994 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:36.123678 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:36.124123 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:36.124541 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:36.252260 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:36.260645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d0bc8569-dfb1-4c24-8cc4-7a36f44e58e4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1518 microversion: 2.1 time: 0.149136 Sep 01 17:33:36.261201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 175/365] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:36 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:36.294009 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:36.294622 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:36.301685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:36.302170 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:36.302608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:36.303306 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:36.303760 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:36.304184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:36.504046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:36.516616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8e7e7daa-729a-41ac-b1c8-0e1f2323ab98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.226329 Sep 01 17:33:36.529590 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 191/366] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:36 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:36.799308 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:36.799950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:36.806479 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:36.806990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:36.807416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:36.808268 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:36.808723 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:36.809141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:36.827426 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:36.999644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:37.007307 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c8c39c72-24e0-4c53-af70-048a48e5d536 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1508 microversion: 2.1 time: 0.212187 Sep 01 17:33:37.007863 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 176/367] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:36 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:37.254309 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-3050755a-5da2-419e-aaa9-34fc9d701c49 req-cd666429-49ee-46c4-b23b-d99d1cf12cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9", "name": "network-vif-deleted", "tag": "1b57bbbb-a7f9-479a-a691-02056e34feeb"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:33:37.265148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-3050755a-5da2-419e-aaa9-34fc9d701c49 req-cd666429-49ee-46c4-b23b-d99d1cf12cea service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:37.265756 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-3050755a-5da2-419e-aaa9-34fc9d701c49 req-cd666429-49ee-46c4-b23b-d99d1cf12cea service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:37.266185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-3050755a-5da2-419e-aaa9-34fc9d701c49 req-cd666429-49ee-46c4-b23b-d99d1cf12cea service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:37.279382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-3050755a-5da2-419e-aaa9-34fc9d701c49 req-cd666429-49ee-46c4-b23b-d99d1cf12cea service nova] Creating event network-vif-deleted:1b57bbbb-a7f9-479a-a691-02056e34feeb for instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 on hv-cinder-85221 Sep 01 17:33:37.285545 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-3050755a-5da2-419e-aaa9-34fc9d701c49 req-cd666429-49ee-46c4-b23b-d99d1cf12cea service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Sep 01 17:33:37.286160 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 192/368] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:33:37.538834 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:37.539394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:37.545401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:37.545884 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:37.546315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:37.546996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:37.547447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:37.547866 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:37.671634 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:37.679433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7ec80937-96cd-4d76-85d6-4da0f4004a02 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.144551 Sep 01 17:33:37.679986 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 177/369] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:37 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:38.029482 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:38.030172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:38.036611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:38.037086 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:38.037541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:38.038217 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:38.038660 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:38.039068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:38.105485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:38.113176 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-33118767-6b4f-49ed-a894-3ddc74054f75 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1466 microversion: 2.1 time: 0.088649 Sep 01 17:33:38.113765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 193/370] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:38 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1466 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:38.699995 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:38.700555 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:38.706506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:38.706984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:38.707413 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:38.708092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:38.708572 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:38.708991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:38.764659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:33:38.766891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:38.773617 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:38.774120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:38.774537 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:38.775226 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:38.775707 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:38.776127 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:38.798738 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lazy-loading 'flavor' on Instance uuid efc18513-a02d-498d-9607-46c4bbd2306a {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:33:38.841150 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:38.849468 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b08e4e11-ef67-4e96-befe-3ebd11833290 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1366 microversion: 2.1 time: 0.153989 Sep 01 17:33:38.850301 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 178/371] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:38 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:38.874273 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c81f57fb-6a7a-4204-ade4-ab28f1904185 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a/action" status: 200 len: 32 microversion: 2.1 time: 0.113539 Sep 01 17:33:38.874870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 194/372] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:33:38 2022] POST /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 17:33:38.885155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:38.885816 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:38.892361 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:38.892844 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:38.893275 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:38.894066 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:38.894525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:38.894940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:39.028644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:39.036317 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c2d65ebd-a0fa-4b44-8e9e-ffc1f60e1276 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.155788 Sep 01 17:33:39.036867 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 179/373] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:38 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:39.135422 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:39.136156 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:39.142819 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:39.143301 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:39.143740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:39.144425 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:39.144874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:39.145293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:39.176867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:39.177365 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:39.177796 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:39.178231 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lazy-loading 'fault' on Instance uuid bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:33:39.222594 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:39.231283 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ffaec9c2-4b72-416f-a145-e498c61d8dc3 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1307 microversion: 2.1 time: 0.100881 Sep 01 17:33:39.231784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 195/374] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:39 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:39.872331 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:39.872929 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:39.878902 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:39.879375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:39.879854 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:39.880533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:39.880981 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:39.881492 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:40.008440 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:40.016367 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2e78d6e6-737d-4100-a7a4-041e0cf47059 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1551 microversion: 2.1 time: 0.148691 Sep 01 17:33:40.016921 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 180/375] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:39 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:40.036758 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-eb2b7a22-6dad-48c7-b374-a7d3ca02d5cd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:40.037231 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-eb2b7a22-6dad-48c7-b374-a7d3ca02d5cd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:40.044172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb2b7a22-6dad-48c7-b374-a7d3ca02d5cd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:40.044651 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb2b7a22-6dad-48c7-b374-a7d3ca02d5cd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:40.045084 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb2b7a22-6dad-48c7-b374-a7d3ca02d5cd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:40.045793 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb2b7a22-6dad-48c7-b374-a7d3ca02d5cd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:40.046247 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb2b7a22-6dad-48c7-b374-a7d3ca02d5cd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:40.046666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb2b7a22-6dad-48c7-b374-a7d3ca02d5cd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:40.056735 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:40.057402 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:40.063515 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:40.064072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:40.064487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:40.065199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:40.065798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:40.066253 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:40.127461 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-eb2b7a22-6dad-48c7-b374-a7d3ca02d5cd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094466 Sep 01 17:33:40.128046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 196/376] 10.222.0.102 () {58 vars in 1280 bytes} [Thu Sep 1 17:33:40 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:33:40.197573 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:40.205213 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b5af7eaf-ca1e-48f5-aaa4-7271ab860523 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.152476 Sep 01 17:33:40.205993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 181/377] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:40 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:33:40.252889 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:40.253611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:40.260016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:40.260501 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:40.260931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:40.262035 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:40.262855 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:40.263548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:40.310443 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:40.310937 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:40.311373 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:40.311821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lazy-loading 'fault' on Instance uuid bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:33:40.369231 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54b95db13d84fc4b026fdd119cb7ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f5e7805e6ae4547a767b7b382a78082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:40.378280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a1ca8dd9-d396-42ba-bc24-6ebc911d34d5 tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 200 len: 1307 microversion: 2.1 time: 0.129979 Sep 01 17:33:40.379059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 197/378] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:40 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:41.106394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-9b9e8979-f427-4b6b-a7df-b422a0451c72 req-492e0f3b-72dc-4b40-8d72-76445f5beed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14064865-1bc2-4b27-993b-cd5e726de947", "tag": "e42b846f-2457-41ca-a620-122194a4dfd4"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:33:41.118668 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-9b9e8979-f427-4b6b-a7df-b422a0451c72 req-492e0f3b-72dc-4b40-8d72-76445f5beed1 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:41.119522 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-9b9e8979-f427-4b6b-a7df-b422a0451c72 req-492e0f3b-72dc-4b40-8d72-76445f5beed1 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:41.120093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-9b9e8979-f427-4b6b-a7df-b422a0451c72 req-492e0f3b-72dc-4b40-8d72-76445f5beed1 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:41.137466 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-9b9e8979-f427-4b6b-a7df-b422a0451c72 req-492e0f3b-72dc-4b40-8d72-76445f5beed1 service nova] Creating event network-changed:e42b846f-2457-41ca-a620-122194a4dfd4 for instance 14064865-1bc2-4b27-993b-cd5e726de947 on hv-cinder-85221 Sep 01 17:33:41.146434 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-9b9e8979-f427-4b6b-a7df-b422a0451c72 req-492e0f3b-72dc-4b40-8d72-76445f5beed1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044968 Sep 01 17:33:41.151398 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 182/379] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:33:41.226975 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:41.229461 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:41.238391 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:41.238898 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:41.239334 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:41.240817 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:41.241908 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:41.242970 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:41.402110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:41.403142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] [instance: bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:41.421830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:41.425855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:41.426555 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:41.428178 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:41.429141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:41.432352 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:41.456665 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:41.466644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ffcaef38-cf34-4d73-9e41-1677b5ee4a3e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.243478 Sep 01 17:33:41.470972 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] HTTP exception thrown: Instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 could not be found. Sep 01 17:33:41.472310 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 198/380] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:41 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Request method failure captured: Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 HTTP/1.1 Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOyf_S_zwke8If6VPb1DSCPsMLUl1HtFSjlxzODsla4Fo2IfuWBo7HuKNreIi_dd9HbZ0XqGy9h4hIm3C-GOdUJffOV8iMuPvV9lIpn0BDlilCDLo8pr3W08yPO_7Z99HFMJCuhJ44BjGpD8Svqq6P99K1eWScbLqZbe_d-IKj1UPSY Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 5f5e7805e6ae4547a767b7b382a78082 Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-VolumesActionsTest-1983495635 Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:33:41.475982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_5f5e7805e6ae4547a767b7b382a78082", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/5f5e7805e6ae4547a767b7b382a78082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/5f5e7805e6ae4547a767b7b382a78082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/5f5e7805e6ae4547a767b7b382a78082"}]}] Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-VolumesActionsTest-1983495635 Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 5f5e7805e6ae4547a767b7b382a78082 Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-VolumesActionsTest-1983495635 Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-VolumesActionsTest-1983495635-project Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: b54b95db13d84fc4b026fdd119cb7ec5 Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-VolumesActionsTest-1983495635-project Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 could not be found. Sep 01 17:33:41.477433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': 'bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9'} Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 could not be found. Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:33:41.478225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 could not be found. Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 could not be found. Sep 01 17:33:41.479557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:33:41.483329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] Returning 404 to user: Instance bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:33:41.484512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3e4b0485-19cf-4f28-abdf-38deb1d71f8c tempest-VolumesActionsTest-1983495635 tempest-VolumesActionsTest-1983495635-project] 10.222.0.102 "GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9" status: 404 len: 111 microversion: 2.1 time: 0.088072 Sep 01 17:33:41.485260 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 183/381] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:41 2022] GET /compute/v2.1/servers/bb91b1be-b8e6-4ba7-b45f-0d8ab0ffa4c9 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:33:42.487951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:42.491490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:42.498937 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:42.499702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:42.500306 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:42.501174 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:42.502583 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:42.503200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:42.733043 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:42.742138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-823fae8d-3660-4576-a7bd-c91511010d1c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.257936 Sep 01 17:33:42.742609 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 199/382] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:42 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:43.764345 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:43.765049 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:43.772460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:43.773326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:43.774048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:43.775189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:43.775796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:43.776375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:44.018500 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:44.026721 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6a2cda92-a731-4b3e-89cf-816486127da3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.266862 Sep 01 17:33:44.027278 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 184/383] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:43 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:45.048131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:45.048903 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:45.052573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=84 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:45.057124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:45.057644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:45.058077 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:45.058809 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:45.059260 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:45.059679 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:45.198673 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:45.206375 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f5effd58-7c57-4b1e-8101-fb0b3185f9b0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.162158 Sep 01 17:33:45.206948 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 200/384] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:45 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:46.229086 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:46.230256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:46.237472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:46.238004 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:46.238423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:46.239358 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:46.240011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:46.240619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:46.473623 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:46.486590 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-239c60ec-0cfe-4f71-8b8e-4649b3fd0afc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.262578 Sep 01 17:33:46.487402 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 185/385] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:46 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:47.509857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:47.511092 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:47.518211 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:47.518211 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:47.518505 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:47.519233 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:47.519865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:47.520290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:47.986159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:47.993994 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-382d959f-6557-4c47-808e-103cbcb6dbf5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.489726 Sep 01 17:33:47.994555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 201/386] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:47 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:49.015906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:49.019986 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:49.029852 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:49.031749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:49.032492 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:49.034053 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:49.034656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:49.035262 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:49.251156 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:49.260443 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-47c38d7b-939c-44a1-8dee-5ac78d4e886c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.248356 Sep 01 17:33:49.273352 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 186/387] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:49 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:50.282901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:50.283507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:50.292860 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:50.296606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:50.297896 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:50.298857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:50.300594 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:50.304342 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:50.553962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:50.576026 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c9e204c3-128d-4a27-ba61-cb7602889de3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.297217 Sep 01 17:33:50.580934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 202/388] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:50 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:51.602770 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:51.603944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:51.606204 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=68 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:51.613132 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:51.613664 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:51.614098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:51.614922 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:51.615235 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:51.615656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:51.885365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:51.898557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-34f5ab57-4fa3-4a73-901b-224c54428fc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.298108 Sep 01 17:33:51.899898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 187/389] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:51 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:52.253173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f1da0351-0f27-4cf9-87f4-99fb3c2069cf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Action: 'create', calling method: .version_select at 0x7fb8568739d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-580347756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVoEB5rlJnBO2YuiUAJGAxsUZyYH0f14W4vGgPf98xU5SDaulR3t0v9GEMJcw3WrNdJP3uDJUY1hgJte5X2f9cLpAYkePOFkLk8I60CLIC9Eu8+6f0vybczsGWroWsYRQ=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:33:52.271393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-f1da0351-0f27-4cf9-87f4-99fb3c2069cf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Getting quotas for project 2cc300abf09e4bb3857336df552286e2. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:33:52.277055 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-f1da0351-0f27-4cf9-87f4-99fb3c2069cf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Getting quotas for user 8f59383e2f6c4da8b683d718f62d25fb and project 2cc300abf09e4bb3857336df552286e2. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:33:52.307467 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f1da0351-0f27-4cf9-87f4-99fb3c2069cf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.271235 Sep 01 17:33:52.308484 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 203/390] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:33:52 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:33:52.919464 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:52.920731 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:52.946712 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:52.947766 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:52.948205 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:52.948908 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:52.949400 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:52.950034 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:53.169896 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:53.181651 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8fc66765-c279-4c59-8c90-1f3a10c4005b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.266248 Sep 01 17:33:53.182326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 188/391] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:52 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:54.206985 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:54.207622 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:54.215896 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:54.216695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:54.217649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:54.218544 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:54.219179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:54.220141 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:54.541385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:54.559447 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-19203d69-9467-4472-93ae-ae595730265b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.360935 Sep 01 17:33:54.573555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 204/392] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:54 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:55.584763 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:55.587008 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:55.593574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:55.594056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:55.594682 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:55.595373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:55.595985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:55.596558 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:55.752246 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:55.767832 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0a25bcaa-425e-4980-95c9-703cd92625e7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.186899 Sep 01 17:33:55.768546 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 189/393] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:55 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:56.788713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:56.789638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:56.796748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:56.797248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:56.797897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:56.798796 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:56.799402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:56.799863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:56.979881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:56.990255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-22417de7-b52b-4888-b5a7-934eb66836d5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.205086 Sep 01 17:33:56.991181 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 205/394] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:56 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:58.011512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:58.012747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:58.019178 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:58.019667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:58.020098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:58.020977 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:58.021457 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:58.022059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:58.168164 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:58.176295 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-38378975-5078-418e-a2cb-816d50904342 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1504 microversion: 2.1 time: 0.168596 Sep 01 17:33:58.177439 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 190/395] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:58 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:58.196804 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3376aae5-386f-4b3d-a88a-595927fe9e55"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:33:58.199344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:58.206040 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:58.206737 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:58.207173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:58.207863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:58.208320 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:58.208737 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:58.235909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] HTTP exception thrown: Cannot 'attach_volume' instance efc18513-a02d-498d-9607-46c4bbd2306a while it is in vm_state rescued Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Request method failure captured: Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: POST /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a/os-volume_attachments HTTP/1.1 Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 74 Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxmaj4UJdfALJiK6W9WL56J0LdsNmogXNfbKS_awQ7no9izWJEl9HWo6Ush6H19mJYyYDfxKKkamKzF82tUc5Tu2yX8ZDJ9rNQwbMa2Na4mJPZDvYqNumOFEJJ1x14D5tKji2TeaJZUgIGvH6LP_eUoyrI7Q-zAjvyRnIuZd2f_3Y8 Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:33:58.237628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_79c90aaff0a44b278807167fdbd38e48", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}] Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: d364c74791fc4cd4af6773433a7a13cc Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {"volumeAttachment": {"volumeId": "3376aae5-386f-4b3d-a88a-595927fe9e55"}} Sep 01 17:33:58.239148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Cannot 'attach_volume' instance efc18513-a02d-498d-9607-46c4bbd2306a while it is in vm_state rescued Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'server_id': 'efc18513-a02d-498d-9607-46c4bbd2306a', 'body': {'volumeAttachment': {'volumeId': '3376aae5-386f-4b3d-a88a-595927fe9e55'}}} Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efc18513-a02d-498d-9607-46c4bbd2306a in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:33:58.240054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance efc18513-a02d-498d-9607-46c4bbd2306a while it is in vm_state rescued Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:33:58.241394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:33:58.242533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:33:58.242533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:33:58.242533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance efc18513-a02d-498d-9607-46c4bbd2306a while it is in vm_state rescued Sep 01 17:33:58.242533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:33:58.242533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Returning 409 to user: Cannot 'attach_volume' instance efc18513-a02d-498d-9607-46c4bbd2306a while it is in vm_state rescued {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:33:58.243264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-65eeaea1-4d68-4425-8fe2-60ee080684b4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050497 Sep 01 17:33:58.247351 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 206/396] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:33:58 2022] POST /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 17:33:58.252431 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a4a04d05-3b45-4588-a8f4-30f341b39ed7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:33:58.253061 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a4a04d05-3b45-4588-a8f4-30f341b39ed7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:58.259506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a04d05-3b45-4588-a8f4-30f341b39ed7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:58.260001 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a04d05-3b45-4588-a8f4-30f341b39ed7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:58.260443 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a04d05-3b45-4588-a8f4-30f341b39ed7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:58.261158 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a04d05-3b45-4588-a8f4-30f341b39ed7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:58.261655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a04d05-3b45-4588-a8f4-30f341b39ed7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:58.262075 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a4a04d05-3b45-4588-a8f4-30f341b39ed7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:58.357126 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a4a04d05-3b45-4588-a8f4-30f341b39ed7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a/action" status: 202 len: 0 microversion: 2.1 time: 0.108468 Sep 01 17:33:58.366149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:58.366847 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:58.371658 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 191/397] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:33:58 2022] POST /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:33:58.379326 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:58.380035 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:58.380500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:58.381184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:58.381652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:58.382097 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:58.421576 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:33:58.556546 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:58.564993 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-79e04daf-aadb-44a9-bdbc-a5f1c0fea31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1512 microversion: 2.1 time: 0.202655 Sep 01 17:33:58.565607 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 207/398] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:58 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:33:59.590212 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:33:59.591651 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:33:59.598093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:59.598777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:59.599521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:59.600420 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:33:59.600885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:33:59.611416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:33:59.849594 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:33:59.857978 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-beead92a-fa10-4151-8d0b-14d87141a1b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1512 microversion: 2.1 time: 0.272660 Sep 01 17:33:59.858769 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 192/399] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:33:59 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:00.879230 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:00.879849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:00.887326 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:00.887964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:00.888477 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:00.889178 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:00.889659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:00.890087 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:01.028997 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:01.038908 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-269f576d-0bc5-4df3-aa0f-c40e51697a9b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1512 microversion: 2.1 time: 0.163969 Sep 01 17:34:01.039752 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 208/400] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:00 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:02.062393 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:02.063170 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:02.072633 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:02.073048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:02.073591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:02.074481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:02.075024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:02.075506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:02.097146 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:02.234521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:02.244933 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c0b762f9-e6d8-441c-8524-4a654c4a7156 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1512 microversion: 2.1 time: 0.187033 Sep 01 17:34:02.249457 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 193/401] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:02 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:03.266314 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:03.267026 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:03.269556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=4 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:03.276660 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:03.277237 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:03.277785 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:03.278579 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:03.279095 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:03.279544 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:03.420777 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:03.428619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-eea422ea-693c-494f-8fd2-0da7bbf1f8d0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1512 microversion: 2.1 time: 0.166289 Sep 01 17:34:03.429173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 209/402] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:03 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:34:04.450300 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:04.450957 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:04.456870 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:04.457417 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:04.457801 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:04.458477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:04.458922 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:04.459336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:04.592291 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:04.600498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-19aa0ab1-a0b9-47b1-a634-a16c7836b12d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1518 microversion: 2.1 time: 0.154166 Sep 01 17:34:04.601090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 194/403] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:04 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:07.194100 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-93e7f8f9-d965-4582-ac2e-ea8acb3d7bee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'create', calling method: .version_select at 0x7fb856bc58b0>, body: {"keypair": {"name": "tempest-keypair-1918740642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8mPlT18Oy1N/ZAFuCLW3vHchONlib4gUxuR5GD+z2m13kT6Pc6EhsncfR1N84EFCVxdC95s0Ho9DordlpWeSYj8ATLBPVIBCKerC3YJGD8pVSoQNETH6UjFu4VtCLpcg=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:34:07.211428 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-93e7f8f9-d965-4582-ac2e-ea8acb3d7bee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Getting quotas for project 79c90aaff0a44b278807167fdbd38e48. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:34:07.215520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-93e7f8f9-d965-4582-ac2e-ea8acb3d7bee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Getting quotas for user d364c74791fc4cd4af6773433a7a13cc and project 79c90aaff0a44b278807167fdbd38e48. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:34:07.240245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-93e7f8f9-d965-4582-ac2e-ea8acb3d7bee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049969 Sep 01 17:34:07.240845 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 210/404] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:34:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:08.791542 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1070213033", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ad650f3-6ca0-408f-a5ce-4fc2e1ab918f"}], "security_groups": [{"name": "tempest-securitygroup--405603851"}], "key_name": "tempest-keypair-1918740642", "user_data": "}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:34:14.596521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=8 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:16.953944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] validate_networks() for [('5ad650f3-6ca0-408f-a5ce-4fc2e1ab918f', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:34:17.353828 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:34:17.354257 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:34:17.354725 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:34:17.355133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:34:17.355537 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:34:17.364697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:17.365175 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:17.365647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:17.366369 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:17.366849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:17.367877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:17.384395 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Getting quotas for project 79c90aaff0a44b278807167fdbd38e48. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:34:17.388274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Getting quotas for user d364c74791fc4cd4af6773433a7a13cc and project 79c90aaff0a44b278807167fdbd38e48. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:34:17.399628 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:34:17.401966 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:34:17.448667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6865ef48-a8fe-4e90-bafd-982d2c171ed0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 8.662701 Sep 01 17:34:17.449331 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 195/405] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:34:08 2022] POST /compute/v2.1/servers => generated 410 bytes in 8664 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:34:17.460144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-bcea11d4-5465-486b-89b3-a60d76f0e172 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:17.460737 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-bcea11d4-5465-486b-89b3-a60d76f0e172 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:17.463262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=16 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:17.464073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=4 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:17.464740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:17.755710 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-bcea11d4-5465-486b-89b3-a60d76f0e172 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:17.763267 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-bcea11d4-5465-486b-89b3-a60d76f0e172 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1250 microversion: 2.1 time: 0.307155 Sep 01 17:34:17.763822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 211/406] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:17 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1250 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:18.784691 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:18.785337 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:18.793210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:18.794770 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:18.795339 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:18.796284 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:18.796923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:18.797451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:18.881661 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:18.892898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0023cdee-db27-4e41-bf91-4bcb9a09b80c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1302 microversion: 2.1 time: 0.111707 Sep 01 17:34:18.894172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 196/407] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:18 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1302 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:19.914692 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:19.915848 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:19.923085 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:19.923552 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:19.923973 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:19.924659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:19.925104 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:19.925545 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:19.986439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:19.994061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c2337a71-0f2f-4dc1-ac1b-fc23b393d584 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1308 microversion: 2.1 time: 0.083744 Sep 01 17:34:19.994620 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 212/408] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:19 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1308 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:21.014461 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:21.015071 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:21.020900 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:21.021425 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:21.021883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:21.022640 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:21.023095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:21.023514 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:21.173245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-7e447513-5211-4e0d-bf81-d4472cde061d req-e2282c1e-2d22-4a88-9ec7-25a60c2879ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea8f35b-6c91-4f1c-8671-1b47c2e93e20", "tag": "57a67469-4a06-4c97-a8c0-1b41de05d545"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:34:21.183536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-7e447513-5211-4e0d-bf81-d4472cde061d req-e2282c1e-2d22-4a88-9ec7-25a60c2879ee service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:21.184272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-7e447513-5211-4e0d-bf81-d4472cde061d req-e2282c1e-2d22-4a88-9ec7-25a60c2879ee service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:21.184699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-7e447513-5211-4e0d-bf81-d4472cde061d req-e2282c1e-2d22-4a88-9ec7-25a60c2879ee service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:21.196035 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-7e447513-5211-4e0d-bf81-d4472cde061d req-e2282c1e-2d22-4a88-9ec7-25a60c2879ee service nova] Creating event network-changed:57a67469-4a06-4c97-a8c0-1b41de05d545 for instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 on hv-cinder-85221 Sep 01 17:34:21.201336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-7e447513-5211-4e0d-bf81-d4472cde061d req-e2282c1e-2d22-4a88-9ec7-25a60c2879ee service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032246 Sep 01 17:34:21.201941 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 213/409] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:21.239322 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:21.247271 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8bce358e-9423-4541-b84c-415d79b9b0b5 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.236585 Sep 01 17:34:21.247871 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 197/410] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:21 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:22.268566 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:22.270378 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:22.278248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:22.278739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:22.279223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:22.280161 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:22.280615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:22.281483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:22.420169 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:22.427995 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-00f0d50d-2725-444a-b2a2-3b971a308ec8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.164053 Sep 01 17:34:22.428563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 214/411] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:22 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:23.449342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:23.449948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:23.451796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:23.458039 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:23.458594 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:23.459076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:23.459809 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:23.460264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:23.461401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:23.590342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:23.598209 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-21450122-4007-453a-bfe9-335641de2863 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.152900 Sep 01 17:34:23.598769 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 198/412] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:23 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:24.619807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:24.620420 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:24.627292 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:24.627927 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:24.628438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:24.629226 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:24.629771 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:24.630264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:24.763931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:24.771715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-738f5876-bced-4a4d-bae2-00407d530b72 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.156229 Sep 01 17:34:24.772270 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 215/413] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:24 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:25.793898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:25.794409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:25.800298 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:25.800775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:25.801239 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:25.801943 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:25.802392 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:25.802814 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:25.928156 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:25.935621 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-324e05c1-5761-4f41-be35-2816f0574b5a tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.145884 Sep 01 17:34:25.936169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 199/414] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:25 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:26.956059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:26.956745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:26.963144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:26.963989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:26.964488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:26.965263 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:26.965839 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:26.966624 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:27.102138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:27.111214 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5b107c00-4650-435e-8949-1a3a207e2f57 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.159041 Sep 01 17:34:27.117184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 216/415] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:26 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:28.139591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:28.141780 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:28.145626 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:28.146410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=6 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:28.151150 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:28.151733 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:28.152240 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:28.153006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:28.153570 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:28.154060 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:28.288207 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:28.296330 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d301df17-1f4e-4ee5-b349-4c1f7e9166b2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.162623 Sep 01 17:34:28.296884 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 200/416] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:28 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:34:29.317106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:29.317768 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:29.319787 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:29.325838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:29.326303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:29.326741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:29.327427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:29.327881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:29.328304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:29.458545 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:29.467072 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e07dcbde-65e6-400e-b4db-8f3a10729565 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.153806 Sep 01 17:34:29.467623 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 217/417] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:29 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:29.672609 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-80815534-fbbf-4793-b6d1-e3deb0821bdb req-14196935-2fc8-43e8-b6eb-7a0f19900013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea8f35b-6c91-4f1c-8671-1b47c2e93e20", "name": "network-vif-plugged", "status": "completed", "tag": "57a67469-4a06-4c97-a8c0-1b41de05d545"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:34:29.682351 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-80815534-fbbf-4793-b6d1-e3deb0821bdb req-14196935-2fc8-43e8-b6eb-7a0f19900013 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:29.682822 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-80815534-fbbf-4793-b6d1-e3deb0821bdb req-14196935-2fc8-43e8-b6eb-7a0f19900013 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:29.683239 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-80815534-fbbf-4793-b6d1-e3deb0821bdb req-14196935-2fc8-43e8-b6eb-7a0f19900013 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:29.694825 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-80815534-fbbf-4793-b6d1-e3deb0821bdb req-14196935-2fc8-43e8-b6eb-7a0f19900013 service nova] Creating event network-vif-plugged:57a67469-4a06-4c97-a8c0-1b41de05d545 for instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 on hv-cinder-85221 Sep 01 17:34:29.699825 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-80815534-fbbf-4793-b6d1-e3deb0821bdb req-14196935-2fc8-43e8-b6eb-7a0f19900013 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030891 Sep 01 17:34:29.700593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 201/418] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:30.487044 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:30.487579 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:30.494040 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:30.494517 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:30.494945 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:30.495626 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:30.496070 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:30.496485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:30.623608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:30.631480 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9a7afc47-6f05-4279-9084-af1c81c42094 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.148360 Sep 01 17:34:30.632581 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 218/419] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:30 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:31.653031 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:31.653801 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:31.659857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:31.660319 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:31.660749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:31.661473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:31.661926 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:31.662345 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:31.796292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:31.804344 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4a14d3e3-eac9-4a9f-90f5-1b56aa8eef6e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.155547 Sep 01 17:34:31.805412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 202/420] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:31 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:32.826677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:32.827568 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:32.835674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:32.836270 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:32.836787 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:32.837619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:32.838208 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:32.838721 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:32.976318 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:32.984396 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d773974e-a0a1-4c7a-85eb-d2348f0c7dc9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1375 microversion: 2.1 time: 0.163048 Sep 01 17:34:32.984950 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 219/421] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:32 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:34.004880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:34.005545 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:34.012276 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:34.012745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:34.013174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:34.014229 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:34.014681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:34.015092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:34.050623 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1154914931", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-580347756", "security_groups": [{"name": "tempest-secgroup-smoke-412480106"}], "block_device_mapping_v2": [{"uuid": "af674d77-3b22-4301-9175-24ad566ee9e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41816984-3dfb-46d4-ba93-ea737106ee4f"}]}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:34:34.149761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:34.157358 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-78d4cf68-fda9-40e1-8bc5-038baff6ceff tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1569 microversion: 2.1 time: 0.156315 Sep 01 17:34:34.157925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 203/422] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:33 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:34:34.171623 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] validate_networks() for [('41816984-3dfb-46d4-ba93-ea737106ee4f', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:34:34.176946 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7ac2b280-57ef-47c5-a6f1-f7ab41204465 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:34.177460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7ac2b280-57ef-47c5-a6f1-f7ab41204465 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:34.183892 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ac2b280-57ef-47c5-a6f1-f7ab41204465 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:34.184579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ac2b280-57ef-47c5-a6f1-f7ab41204465 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:34.185008 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ac2b280-57ef-47c5-a6f1-f7ab41204465 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:34.185717 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ac2b280-57ef-47c5-a6f1-f7ab41204465 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:34.186169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ac2b280-57ef-47c5-a6f1-f7ab41204465 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:34.186587 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ac2b280-57ef-47c5-a6f1-f7ab41204465 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:34.263194 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7ac2b280-57ef-47c5-a6f1-f7ab41204465 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089942 Sep 01 17:34:34.263953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 204/423] 10.222.0.102 () {58 vars in 1280 bytes} [Thu Sep 1 17:34:34 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:34:34.550708 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:34:34.551251 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:34:34.551819 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:34:34.552286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:34:34.552703 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:34:34.562552 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:34.563038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:34.563475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:34.564198 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:34.564651 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:34.565074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:34.581874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Getting quotas for project 2cc300abf09e4bb3857336df552286e2. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:34:34.585865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Getting quotas for user 8f59383e2f6c4da8b683d718f62d25fb and project 2cc300abf09e4bb3857336df552286e2. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:34:34.658557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:34:34.660806 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af674d77-3b22-4301-9175-24ad566ee9e5',volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:34:34.795699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-67075345-833e-4ee0-87b7-14e0f7395176 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.748709 Sep 01 17:34:34.796485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 220/424] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:34:34 2022] POST /compute/v2.1/servers => generated 407 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 01 17:34:34.809388 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-08f6c294-9c06-49cd-a9fa-949495feffa1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:34.809612 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-08f6c294-9c06-49cd-a9fa-949495feffa1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:34.889930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-08f6c294-9c06-49cd-a9fa-949495feffa1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:34.898056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-08f6c294-9c06-49cd-a9fa-949495feffa1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1097 microversion: 2.1 time: 0.094638 Sep 01 17:34:34.899126 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 205/425] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:34 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1097 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:34:35.474803 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-faa0e3a5-d417-4b4e-a563-8c37c68217a5 req-001b3463-e38e-4940-a238-b9b4859b3d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea8f35b-6c91-4f1c-8671-1b47c2e93e20", "tag": "57a67469-4a06-4c97-a8c0-1b41de05d545"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:34:35.484900 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-faa0e3a5-d417-4b4e-a563-8c37c68217a5 req-001b3463-e38e-4940-a238-b9b4859b3d50 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:35.485393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-faa0e3a5-d417-4b4e-a563-8c37c68217a5 req-001b3463-e38e-4940-a238-b9b4859b3d50 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:35.485822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-faa0e3a5-d417-4b4e-a563-8c37c68217a5 req-001b3463-e38e-4940-a238-b9b4859b3d50 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:35.496713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-faa0e3a5-d417-4b4e-a563-8c37c68217a5 req-001b3463-e38e-4940-a238-b9b4859b3d50 service nova] Creating event network-changed:57a67469-4a06-4c97-a8c0-1b41de05d545 for instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 on hv-cinder-85221 Sep 01 17:34:35.501867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-faa0e3a5-d417-4b4e-a563-8c37c68217a5 req-001b3463-e38e-4940-a238-b9b4859b3d50 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031176 Sep 01 17:34:35.502809 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 221/426] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:35.919007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:35.919542 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:35.925381 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:35.925881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:35.926293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:35.926976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:35.927437 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:35.927855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:35.988618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:35.996817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c62aac6b-bbd1-4d6e-ae39-40ffeae96f10 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1195 microversion: 2.1 time: 0.081727 Sep 01 17:34:35.997396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 206/427] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:35 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1195 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:37.019001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:37.019610 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:37.025798 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:37.026272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:37.026702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:37.027379 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:37.027824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:37.028244 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:37.089796 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:37.097603 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-321345a1-69ec-4ef5-b8d8-82659636fcb8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1195 microversion: 2.1 time: 0.083406 Sep 01 17:34:37.098154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 222/428] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:37 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1195 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:38.118249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:38.118772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:38.124582 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:38.125052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:38.125518 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:38.126187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:38.126629 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:38.127038 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:38.186805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:38.194389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8170abe3-6643-4472-9bdf-67b6a71aa80e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1195 microversion: 2.1 time: 0.080171 Sep 01 17:34:38.195429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 207/429] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:38 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1195 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:39.216057 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:39.216630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:39.223677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:39.224197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:39.224661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:39.225429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:39.225929 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:39.227016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:39.289209 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:39.297330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-aab4556f-c0ec-4c27-a8f8-4a09d67e67dd tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1195 microversion: 2.1 time: 0.085720 Sep 01 17:34:39.297923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 223/430] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:39 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1195 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:40.318000 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:40.318602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:40.324451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:40.324921 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:40.325362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:40.326035 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:40.326477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:40.326889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:40.390675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:40.398373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3b7185f0-b840-4c80-8e79-5c4841f8126a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1213 microversion: 2.1 time: 0.084263 Sep 01 17:34:40.398901 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 208/431] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:40 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:41.424201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:41.425728 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:41.436514 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:41.437371 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:41.438114 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:41.439321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:41.440115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:41.440835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:41.641408 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:41.650856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-eb1f3593-88c5-4a64-9130-48c469cdf2ce tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1280 microversion: 2.1 time: 0.234435 Sep 01 17:34:41.651666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 224/432] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:41 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1280 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:42.071917 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-8f5a9899-dccf-4c7f-a398-42467b5bb6f5 req-9160b43d-a704-4e7d-8f4b-e9c3ffd99d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbbe128c-ca7d-41f4-9013-2110694968fa", "tag": "d8c0604b-0167-41b0-811b-5a0f5ab981b6"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:34:42.096282 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-8f5a9899-dccf-4c7f-a398-42467b5bb6f5 req-9160b43d-a704-4e7d-8f4b-e9c3ffd99d49 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:42.096993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-8f5a9899-dccf-4c7f-a398-42467b5bb6f5 req-9160b43d-a704-4e7d-8f4b-e9c3ffd99d49 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:42.097681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-8f5a9899-dccf-4c7f-a398-42467b5bb6f5 req-9160b43d-a704-4e7d-8f4b-e9c3ffd99d49 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:42.111200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-8f5a9899-dccf-4c7f-a398-42467b5bb6f5 req-9160b43d-a704-4e7d-8f4b-e9c3ffd99d49 service nova] Creating event network-changed:d8c0604b-0167-41b0-811b-5a0f5ab981b6 for instance bbbe128c-ca7d-41f4-9013-2110694968fa on hv-cinder-85221 Sep 01 17:34:42.118828 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-8f5a9899-dccf-4c7f-a398-42467b5bb6f5 req-9160b43d-a704-4e7d-8f4b-e9c3ffd99d49 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050867 Sep 01 17:34:42.119902 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 209/433] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:42.673678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:42.674276 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:42.680827 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:42.681316 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:42.681747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:42.682419 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:42.682862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:42.683278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:42.810671 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:42.818484 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7490df94-7e13-4f14-92ed-97789f60f19b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.148927 Sep 01 17:34:42.819049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 225/434] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:42 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:43.839236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:43.839926 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:43.846549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:43.847022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:43.847450 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:43.848130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:43.848586 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:43.849001 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:43.982294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:43.989939 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-96cbb326-180a-4f59-a210-7af6f20158e6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.155023 Sep 01 17:34:43.990497 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 210/435] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:43 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:45.011442 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:45.012050 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:45.014489 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:45.015177 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:45.020560 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:45.021037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:45.021498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:45.022181 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:45.022629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:45.023046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:45.156552 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:45.164335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-46f9f94a-64ca-4558-ac22-7ccb906b3313 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.157326 Sep 01 17:34:45.164895 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 226/436] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:45 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:46.183988 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:46.184593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:46.186623 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:46.191992 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:46.192473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:46.192898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:46.193640 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:46.194089 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:46.194506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:46.198842 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=77 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:46.330767 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:46.339409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-406960e8-f1f4-464a-a5cc-9885314293b1 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.159336 Sep 01 17:34:46.339966 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 211/437] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:46 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:47.360150 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:47.360758 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:47.367923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:47.368398 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:47.368821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:47.369534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:47.369980 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:47.370393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:47.506538 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:47.508724 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=83 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:47.515572 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-61ee8c91-3906-45ba-a9ca-594a6d89aec2 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.159247 Sep 01 17:34:47.516138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 227/438] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:47 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:48.538601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:48.539725 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:48.545890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:48.546397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:48.546856 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:48.547538 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:48.547992 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:48.548413 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:48.678046 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:48.686937 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1b1b3a4b-113b-46d0-ae7d-4cee3ac671b0 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.152565 Sep 01 17:34:48.687502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 212/439] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:48 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:49.707677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:49.708348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:49.711031 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:49.717039 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:49.717700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:49.718276 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:49.719411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:49.720209 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:49.720974 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:49.858626 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:49.866345 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0b4faa6b-d4aa-4d7a-92dd-9cf6c6ac7ca6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.162566 Sep 01 17:34:49.866897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 228/440] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:49 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:50.887691 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:50.888305 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:50.894338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:50.894813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:50.895237 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:50.895925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:50.896370 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:50.896785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:51.030540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:51.038840 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ca9a7749-681d-4eba-a097-ab5dd5d2ee09 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.155059 Sep 01 17:34:51.039450 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 213/441] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:50 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:52.059417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:52.060028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:52.066605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:52.067084 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:52.067515 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:52.068201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:52.068655 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:52.069079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:52.203644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:52.211378 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c46dba50-b4aa-4a54-a283-173e890760b7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.155852 Sep 01 17:34:52.211923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 229/442] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:52 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:53.232673 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:53.233228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:53.239192 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:53.239671 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:53.240102 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:53.240781 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:53.241230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:53.241674 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:53.372686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:53.380386 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4f6a206f-d1ec-4e00-bec6-f090c9ee664c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.151778 Sep 01 17:34:53.380968 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 214/443] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:53 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:54.272734 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-6a1ed09d-f921-4c12-8e75-37e90c2d0da2 req-931c3556-43d6-4e11-9194-fffdd7749876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbe128c-ca7d-41f4-9013-2110694968fa", "name": "network-vif-plugged", "status": "completed", "tag": "d8c0604b-0167-41b0-811b-5a0f5ab981b6"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:34:54.282818 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6a1ed09d-f921-4c12-8e75-37e90c2d0da2 req-931c3556-43d6-4e11-9194-fffdd7749876 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:54.283335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6a1ed09d-f921-4c12-8e75-37e90c2d0da2 req-931c3556-43d6-4e11-9194-fffdd7749876 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:54.283767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6a1ed09d-f921-4c12-8e75-37e90c2d0da2 req-931c3556-43d6-4e11-9194-fffdd7749876 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:54.295986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-6a1ed09d-f921-4c12-8e75-37e90c2d0da2 req-931c3556-43d6-4e11-9194-fffdd7749876 service nova] Creating event network-vif-plugged:d8c0604b-0167-41b0-811b-5a0f5ab981b6 for instance bbbe128c-ca7d-41f4-9013-2110694968fa on hv-cinder-85221 Sep 01 17:34:54.301290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-6a1ed09d-f921-4c12-8e75-37e90c2d0da2 req-931c3556-43d6-4e11-9194-fffdd7749876 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032382 Sep 01 17:34:54.302302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 230/444] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:34:54.413459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:54.413459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:54.413459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=36 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:34:54.413459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:54.413459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:54.414533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:54.414533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:54.414533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:54.414533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:54.551045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:54.558825 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e145d4bd-c183-4df9-b6bb-4a92e183cfdf tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.160712 Sep 01 17:34:54.560158 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 215/445] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:54 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:55.580451 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:55.581144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:55.588214 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:55.588686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:55.589112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:55.589811 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:55.591012 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:55.591426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:55.720614 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:55.728251 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-18a7640e-47a9-4a61-becc-4e84d7e6c78f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.152026 Sep 01 17:34:55.728804 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 231/446] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:55 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:56.753183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:56.753745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:56.759972 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:56.760450 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:56.760884 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:56.761595 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:56.762543 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:56.762969 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:56.894087 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:56.906576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ccad2929-a29d-49d2-a29e-975ca9b8cd6c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1268 microversion: 2.1 time: 0.157238 Sep 01 17:34:56.907145 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 216/447] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:56 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:57.927580 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:57.928169 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:57.934698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:57.935177 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:57.935609 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:57.936288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:57.936736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:57.937157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:58.068888 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:58.077856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3656c77f-2232-4aa5-b350-359230b86d39 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1454 microversion: 2.1 time: 0.153941 Sep 01 17:34:58.078445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 232/448] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:57 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:34:58.099200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:34:58.099806 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:34:58.105794 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:58.106271 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:58.106703 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:58.107381 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:58.107828 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:58.108248 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:58.243817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:34:58.252604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b915e7ed-7cdc-4bee-945f-0dd996e086e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1454 microversion: 2.1 time: 0.156981 Sep 01 17:34:58.253294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 217/449] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:34:58 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:34:59.964300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-466459b6-0e23-452d-a62d-30bec01a327e req-868ccb83-d401-4da6-b518-137e3b2629e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbbe128c-ca7d-41f4-9013-2110694968fa", "tag": "d8c0604b-0167-41b0-811b-5a0f5ab981b6"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:34:59.974029 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-466459b6-0e23-452d-a62d-30bec01a327e req-868ccb83-d401-4da6-b518-137e3b2629e4 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:34:59.974499 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-466459b6-0e23-452d-a62d-30bec01a327e req-868ccb83-d401-4da6-b518-137e3b2629e4 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:34:59.974913 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-466459b6-0e23-452d-a62d-30bec01a327e req-868ccb83-d401-4da6-b518-137e3b2629e4 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:34:59.985913 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-466459b6-0e23-452d-a62d-30bec01a327e req-868ccb83-d401-4da6-b518-137e3b2629e4 service nova] Creating event network-changed:d8c0604b-0167-41b0-811b-5a0f5ab981b6 for instance bbbe128c-ca7d-41f4-9013-2110694968fa on hv-cinder-85221 Sep 01 17:34:59.990636 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-466459b6-0e23-452d-a62d-30bec01a327e req-868ccb83-d401-4da6-b518-137e3b2629e4 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030056 Sep 01 17:34:59.991216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 233/450] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:35:12.949531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7d638e23-d511-4afe-bed4-abc67747b1b4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:12.950090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7d638e23-d511-4afe-bed4-abc67747b1b4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:12.952060 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=5 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:12.952881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=41 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:12.958482 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d638e23-d511-4afe-bed4-abc67747b1b4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:12.958961 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d638e23-d511-4afe-bed4-abc67747b1b4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:12.959391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d638e23-d511-4afe-bed4-abc67747b1b4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:12.960070 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d638e23-d511-4afe-bed4-abc67747b1b4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:12.960521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d638e23-d511-4afe-bed4-abc67747b1b4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:12.960933 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d638e23-d511-4afe-bed4-abc67747b1b4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:12.985706 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7d638e23-d511-4afe-bed4-abc67747b1b4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/ips" status: 200 len: 150 microversion: 2.20 time: 0.040077 Sep 01 17:35:12.986255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 218/451] 10.222.0.102 () {60 vars in 1294 bytes} [Thu Sep 1 17:35:12 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:35:15.951077 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=11 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:15.951811 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=29 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:15.956135 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:35:15.956747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:15.963901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:15.964632 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:15.965060 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:15.965765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:15.966217 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:15.966634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:15.988462 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lazy-loading 'flavor' on Instance uuid b61004bf-b919-4848-8efa-ba83a2a8e633 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:35:16.163966 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f1d3863b-5a13-4658-8c77-deec9bee1f65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/action" status: 202 len: 0 microversion: 2.20 time: 0.214870 Sep 01 17:35:16.164950 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 234/452] 10.222.0.102 () {62 vars in 1324 bytes} [Thu Sep 1 17:35:15 2022] POST /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:35:16.173563 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:16.174166 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:16.181584 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:16.182156 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:16.182635 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:16.183447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:16.183924 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:16.184414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:16.321106 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:16.329101 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:16.330553 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:16.331684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2f2e3f91-081a-42d5-8b7e-5110a775661d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.162457 Sep 01 17:35:16.332224 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 219/453] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:16 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:17.356325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:17.357090 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:17.364320 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:17.364796 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:17.365254 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:17.365962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:17.366411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:17.366827 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:17.497188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:17.505731 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:17.507199 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:17.508421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f953c219-da1b-4098-92c5-3b34f314f9e7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.156978 Sep 01 17:35:17.508916 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 235/454] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:17 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:18.531949 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:18.532553 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:18.538561 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:18.539042 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:18.539471 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:18.540156 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:18.540611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:18.541030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:18.671500 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:18.679742 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:18.681215 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:18.682394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b5d15cf0-b60f-43a3-a1f4-ad5461e54e4f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.154948 Sep 01 17:35:18.682950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 220/455] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:18 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:19.705573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:19.706193 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:19.712588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:19.713068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:19.713547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:19.714536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:19.714991 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:19.715413 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:19.850725 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:19.858911 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:19.860439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:19.861733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6553d2fd-3159-453e-92f3-01a8512d790e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.160534 Sep 01 17:35:19.862366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 236/456] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:19 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:20.883939 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:20.884539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:20.890491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:20.890960 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:20.891387 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:20.892065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:20.892513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:20.892912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:21.029404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:21.038355 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:21.039803 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:21.041090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c75c7abc-845a-4053-a820-49a2806d875d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.161113 Sep 01 17:35:21.041666 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 221/457] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:20 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:22.064600 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:22.065388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:22.072536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:22.073368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:22.074003 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:22.074767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:22.075303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:22.075794 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:22.261057 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:22.271288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:22.272865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:22.274201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d0e3f36e-04fc-4cee-a2f1-2acd019732df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.213805 Sep 01 17:35:22.274871 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 237/458] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:22 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:23.298792 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:23.299407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:23.305944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:23.306432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:23.307127 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:23.307822 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:23.308513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:23.309117 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:23.552945 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:23.563657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:23.565515 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:23.567207 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-95bb9837-1bc2-4b7c-933b-68281d0983c7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.272780 Sep 01 17:35:23.568619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 222/459] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:23 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:24.592713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:24.594338 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:24.601452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:24.602085 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:24.602645 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:24.603448 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:24.604890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:24.605520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:24.766522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:24.777445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:24.778881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:24.780110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2f45dd8e-7f89-45f6-b534-c347d90d049c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.193258 Sep 01 17:35:24.781037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 238/460] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:24 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:25.804994 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:25.805635 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:25.813084 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:25.813553 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:25.813998 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:25.814655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:25.815779 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:25.816359 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:26.291678 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:26.301952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:26.303400 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:26.304562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c55c020d-3148-4609-b633-c5443c7a48ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.505432 Sep 01 17:35:26.305109 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 223/461] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:25 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:27.327343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:27.328627 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:27.335766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:27.336898 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:27.336898 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:27.337747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:27.338397 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:27.339389 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:27.528095 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:27.539518 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:27.540962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:27.542205 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-bde304b2-5abd-4779-8ab8-cbe606b64106 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.218970 Sep 01 17:35:27.542757 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 239/462] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:27 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:28.566817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:28.567538 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:28.581092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:28.585232 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:28.586472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:28.589212 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:28.590011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:28.602837 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:28.875965 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:28.889211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:28.892187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:28.894155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6b158a05-5b19-47a5-813a-1f7eb3bfd285 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.332549 Sep 01 17:35:28.913401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 224/463] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:28 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:29.917216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:29.919034 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:29.927290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:29.928433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:29.929245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:29.930207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:29.931007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:29.931652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:30.098502 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:30.113698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:30.115145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:30.116359 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e6dc855d-434b-43bf-8ec3-38ba4450ced5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.203060 Sep 01 17:35:30.116921 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 240/464] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:29 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:31.143256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:31.143869 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:31.157098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:31.160790 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:31.161472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:31.162375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:31.163024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:31.163598 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:31.377681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:31.386510 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:31.389501 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:31.390865 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fbcc7d74-1b35-492f-ba68-43bd90dd024a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.255251 Sep 01 17:35:31.395354 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 225/465] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:31 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:32.415395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:32.417186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:32.429217 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:32.429869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:32.430383 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:32.431227 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:32.431758 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:32.432252 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:32.706951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:32.716255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:32.718767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:32.720192 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a063c758-6cf9-4b23-8d9a-0625fccefe5e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.310410 Sep 01 17:35:32.721352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 241/466] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:32 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:33.744341 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:33.746914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:33.759644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:33.760385 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:33.761257 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:33.763612 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:33.764644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:33.765778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:33.936868 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:33.945912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:33.948204 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:33.949172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-68cd5561-46fa-46e5-8789-8edf2d52690a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1745 microversion: 2.20 time: 0.209868 Sep 01 17:35:33.949787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 226/467] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:33 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1745 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:34.973700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:34.974307 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:34.981022 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:34.982298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:34.982884 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:34.983741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:34.984334 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:34.984922 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:35.154972 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:35.164456 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:35.166177 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:35.167525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9f88947b-8fff-4aba-9beb-98cca5fb097c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1745 microversion: 2.20 time: 0.199098 Sep 01 17:35:35.168435 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 242/468] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:34 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1745 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:36.191170 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:36.191703 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:36.197710 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:36.198187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:36.198618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:36.199295 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:36.199741 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:36.200155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:36.343023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:36.351251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:36.352985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:36.354435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c9602196-d961-453b-8aa3-7f5b1f5e15f4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1745 microversion: 2.20 time: 0.167234 Sep 01 17:35:36.355566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 227/469] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:36 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:36.564313 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-c2814e51-3429-4a78-a453-69b75341c668 req-e58ddb32-f9a1-4d93-a6e1-d106034acbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61004bf-b919-4848-8efa-ba83a2a8e633", "name": "network-vif-plugged", "status": "completed", "tag": "57a21496-3b93-45c7-9205-d2fd2b7131e5"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:35:36.580504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-c2814e51-3429-4a78-a453-69b75341c668 req-e58ddb32-f9a1-4d93-a6e1-d106034acbbb service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:36.581299 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-c2814e51-3429-4a78-a453-69b75341c668 req-e58ddb32-f9a1-4d93-a6e1-d106034acbbb service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:36.582126 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-c2814e51-3429-4a78-a453-69b75341c668 req-e58ddb32-f9a1-4d93-a6e1-d106034acbbb service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:36.600782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-c2814e51-3429-4a78-a453-69b75341c668 req-e58ddb32-f9a1-4d93-a6e1-d106034acbbb service nova] Creating event network-vif-plugged:57a21496-3b93-45c7-9205-d2fd2b7131e5 for instance b61004bf-b919-4848-8efa-ba83a2a8e633 on hv-cinder-85221 Sep 01 17:35:36.608768 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-c2814e51-3429-4a78-a453-69b75341c668 req-e58ddb32-f9a1-4d93-a6e1-d106034acbbb service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049278 Sep 01 17:35:36.610710 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 243/470] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:35:37.378287 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:37.378889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:37.385258 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:37.386152 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:37.386657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:37.387522 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:37.388715 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:37.389355 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:37.534759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:37.543473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:37.546025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:37.547466 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-000d1ac2-15f6-4503-9e2c-c999a429ea58 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1745 microversion: 2.20 time: 0.173234 Sep 01 17:35:37.548103 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 228/471] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:37 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:38.572898 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:38.573629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:38.580380 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:38.581068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:38.581739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:38.582634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:38.583090 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:38.583511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:38.736036 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:38.745542 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:38.747555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:38.748851 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-30b3d17b-544b-4321-b28c-3cb13fa7051e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1745 microversion: 2.20 time: 0.180485 Sep 01 17:35:38.749781 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 244/472] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:38 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:39.383957 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ed03e1c6-01c0-4753-8fea-787a4b37eb12 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Action: 'create', calling method: .version_select at 0x7fb8569c64c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-226298924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZrKckF4khfCmb3EAhmyTrd9ltgqRu3QgDnomxxA6efSO1xNGAI2GRSwErPZoUO/lpxvn4JBOMM3j5jMJiK4B8XjMoCoko4qu2HsCALhwvc1hrfAYf0IaJDfpZykq1v8A=="}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:35:39.403552 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-ed03e1c6-01c0-4753-8fea-787a4b37eb12 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Getting quotas for project 9644529eb8a94aa39e326871bc7b73e1. Resources: {'key_pairs'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:35:39.407378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-ed03e1c6-01c0-4753-8fea-787a4b37eb12 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Getting quotas for user 333dc785d4a84d56bd33a6b305dec2f7 and project 9644529eb8a94aa39e326871bc7b73e1. Resources: {'key_pairs'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:35:39.443473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ed03e1c6-01c0-4753-8fea-787a4b37eb12 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063388 Sep 01 17:35:39.444052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 229/473] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:35:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:35:39.495478 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1013541830", "imageRef": "28ec6779-e6ca-4197-9a2d-4a957ab9b042", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-226298924", "networks": [{"uuid": "669398ab-30f5-4bcc-b36c-6811c4e30d85"}]}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:35:39.547404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] validate_networks() for [('669398ab-30f5-4bcc-b36c-6811c4e30d85', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:35:39.773365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:39.773911 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:39.780649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:39.781141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:39.781612 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:39.782312 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:39.782759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:39.783175 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:39.920079 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:39.928996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:39.930611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:39.931764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3322af61-73b7-4fc1-ac20-82a3dff905dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1745 microversion: 2.20 time: 0.162655 Sep 01 17:35:39.932319 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 230/474] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:39 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:35:40.120977 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:35:40.121488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:35:40.122445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:35:40.122857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:35:40.123259 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:35:40.131964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:40.132430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:40.132852 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:40.133594 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:40.134035 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:40.134445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:40.150613 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Getting quotas for project 9644529eb8a94aa39e326871bc7b73e1. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:35:40.154504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Getting quotas for user 333dc785d4a84d56bd33a6b305dec2f7 and project 9644529eb8a94aa39e326871bc7b73e1. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:35:40.165203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:35:40.167413 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='28ec6779-e6ca-4197-9a2d-4a957ab9b042',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:35:40.213525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-feca65b6-4fa8-4162-87f0-b636e414b0dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.722732 Sep 01 17:35:40.214149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 245/475] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:35:39 2022] POST /compute/v2.1/servers => generated 382 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 01 17:35:40.224716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b9ff4d69-4e21-4a73-853a-6fb7f67b01a2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:40.225346 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b9ff4d69-4e21-4a73-853a-6fb7f67b01a2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:40.279530 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b9ff4d69-4e21-4a73-853a-6fb7f67b01a2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:40.287111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b9ff4d69-4e21-4a73-853a-6fb7f67b01a2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1262 microversion: 2.1 time: 0.066298 Sep 01 17:35:40.287676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 231/476] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:40 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1262 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:40.955749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:40.956353 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:40.963337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:40.963961 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:40.964435 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:40.965125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:40.966244 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:40.966715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:41.099575 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:41.108234 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:41.109689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:41.110864 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d2d5f76c-7205-4654-80d2-5d52a88d12a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1745 microversion: 2.20 time: 0.159657 Sep 01 17:35:41.111402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 246/477] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:40 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:41.307526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:41.308134 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:41.314175 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:41.314653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:41.315083 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:41.315758 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:41.316206 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:41.316627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:41.378143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:41.386967 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f7812b51-b492-43ff-baca-9bd98ae3da6e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1314 microversion: 2.1 time: 0.082953 Sep 01 17:35:41.387091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 232/478] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:41 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1314 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:42.134884 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:42.135755 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:42.157293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:42.157811 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:42.158245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:42.158949 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:42.159403 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:42.159822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:42.340400 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:42.352998 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:42.355068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:42.356844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-44f240d7-535a-4774-bff8-e6792a74bdcf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1745 microversion: 2.20 time: 0.225985 Sep 01 17:35:42.385755 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 247/479] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:42 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1745 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:42.408732 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:42.409928 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:42.418760 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:42.421874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:42.422907 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:42.425492 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:42.426451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:42.428315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:42.689921 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:42.705444 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-960ae428-b937-4936-a5f3-8f9f2b0f85bd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.302156 Sep 01 17:35:42.706580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 233/480] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:42 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:43.382517 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:43.383124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:43.390344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:43.391081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:43.391763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:43.392475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:43.392933 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:43.393390 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:43.535112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:43.544925 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:43.546706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:43.547947 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-62f018ef-979a-4edb-99d9-06f95b51a3ea tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.169415 Sep 01 17:35:43.548564 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 248/481] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:43 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:43.726947 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:43.727496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:43.729256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:43.735491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:43.735935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:43.736361 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:43.737130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:43.737651 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:43.738032 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:43.742531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=83 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:43.884650 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:43.892569 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4882ce88-feaf-4d02-ba2c-b64cb0a8e08b tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.169548 Sep 01 17:35:43.893341 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 234/482] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:43 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:35:44.570834 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:44.571597 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:44.578573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:44.579046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:44.579473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:44.580146 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:44.580589 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:44.581002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:44.721239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:44.725286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:44.732269 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:44.734528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:44.735689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d1e5b18a-aad7-4521-9cc6-88b7a11c18e1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.168769 Sep 01 17:35:44.736240 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 249/483] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:44 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:44.914464 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:44.914974 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:44.921555 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:44.922027 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:44.922459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:44.923130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:44.923574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:44.923987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:45.060953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:45.068796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d268085d-e18f-42d2-a990-48bcb41875cb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.158287 Sep 01 17:35:45.069634 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 235/484] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:44 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:45.760342 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:45.760892 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:45.768690 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:45.769260 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:45.769788 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:45.770503 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:45.770954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:45.771373 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:45.915950 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:45.924353 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:45.925800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:45.926942 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3b531143-be1d-452e-bf3e-19fbf2d53483 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.171195 Sep 01 17:35:45.927489 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 250/485] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:45 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:46.088732 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:46.089529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:46.096118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:46.096602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:46.097029 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:46.097752 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:46.098195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:46.098609 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:46.238857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:46.247002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-434cf74b-6b97-463f-afb4-045f81040cb0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.162510 Sep 01 17:35:46.247561 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 236/486] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:46 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:46.951871 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:46.952468 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:46.954754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:46.960399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:46.960879 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:46.961326 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:46.962028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:46.962475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:46.963149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:47.096932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:47.104977 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:47.106472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:47.107767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f54cfb9d-d5ad-496a-aee3-10a8f4acfaab tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.160383 Sep 01 17:35:47.108525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 251/487] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:46 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:47.268526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:47.269181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:47.275568 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:47.276051 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:47.276512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:47.277211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:47.277873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:47.278298 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:47.413409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:47.421292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fa490572-de98-46dc-a466-271bb34f28e4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.156651 Sep 01 17:35:47.421872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 237/488] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:47 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:48.130410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:48.131060 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:48.138139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:48.138633 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:48.139069 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:48.140903 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:48.141411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:48.141846 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:48.281592 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:48.289822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:48.291802 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:48.293024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8d76b308-2d5c-4dd4-b841-b31bb3b2dbdd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.166661 Sep 01 17:35:48.293614 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 252/489] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:48 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:48.442308 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:48.442958 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:48.449693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:48.450393 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:48.451539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:48.452448 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:48.453093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:48.453735 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:48.588831 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:48.597005 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b5c10c73-9c45-4dbc-bd97-361d2d6fb871 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.158907 Sep 01 17:35:48.597604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 238/490] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:48 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:49.316593 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:49.317193 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:49.323643 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:49.324117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:49.324544 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:49.325218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:49.325702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:49.326115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:49.465020 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:49.474797 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:49.476232 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:49.477601 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-18f1875c-dc7b-4d38-864e-7b5121b5fe22 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.164754 Sep 01 17:35:49.478349 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 253/491] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:49 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:49.679458 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:49.681025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:49.688391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:49.689208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:49.689966 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:49.691110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:49.691861 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:49.692572 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:49.825602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:49.833778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5168eac4-20aa-4727-81a3-3835962c51a5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.158327 Sep 01 17:35:49.834474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 239/492] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:49 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:50.506759 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:50.507406 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:50.509255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:50.509941 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:50.516218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:50.516783 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:50.517248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:50.517979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:50.518433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:50.518855 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:50.662108 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:50.670203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:50.671615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:50.672740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6766eddc-4194-40b6-b8b5-87bfd1c723a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.176559 Sep 01 17:35:50.673286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 254/493] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:50 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:50.855619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:50.856198 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:50.858043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=6 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:35:50.863318 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:50.863930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:50.864485 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:50.865201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:50.874341 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:50.874877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:51.011256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:51.020168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-148c4098-4fc3-4ba1-8f76-67082f484362 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.168529 Sep 01 17:35:51.020693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 240/494] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:50 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:51.695072 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:51.695756 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:51.702243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:51.702716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:51.703140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:51.703813 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:51.704255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:51.704668 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:51.845660 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:51.855664 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:51.857833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:51.859115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f2dc5469-cf05-42c0-a02f-7d184262cc7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.167884 Sep 01 17:35:51.859724 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 255/495] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:51 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:52.039848 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:52.040457 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:52.046593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:52.047068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:52.047497 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:52.048182 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:52.048630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:52.049048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:52.180946 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:52.188787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-14e2761d-6bae-4464-a921-96e032ec2985 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.152771 Sep 01 17:35:52.189412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 241/496] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:52 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:35:52.883106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:52.883814 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:52.890482 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:52.890964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:52.891397 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:52.892090 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:52.892544 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:52.892988 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:53.033245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:53.041579 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:53.043014 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:53.044168 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-26a336dc-fef8-43e4-9101-9b7daf726ed4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.165104 Sep 01 17:35:53.045204 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 256/497] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:52 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:53.210024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:53.210764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:53.223889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:53.223889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:53.223889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:53.223889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:53.224386 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:53.224386 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:53.355718 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:53.364322 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7955b1bb-78cb-4b95-9c05-b8409d9eab61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.158218 Sep 01 17:35:53.364876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 242/498] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:53 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:54.068682 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:54.069246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:54.077849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:54.078508 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:54.079429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:54.080555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:54.081181 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:54.081772 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:54.221458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:54.229538 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:54.230962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:54.232586 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6e406e40-6440-474c-9279-38efb1490f25 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.167806 Sep 01 17:35:54.233136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 257/499] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:54 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:54.385580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:54.386211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:54.392800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:54.393320 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:54.393750 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:54.394435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:54.394877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:54.395321 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:54.525270 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:54.533692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-95134cc7-2167-47bb-a14e-116ec0b4f3f2 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.152167 Sep 01 17:35:54.534256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 243/500] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:54 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:55.255608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:55.256084 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:55.262560 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:55.263040 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:55.263472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:55.264157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:55.264634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:55.265053 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:55.393200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:55.401922 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:55.403359 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:55.404996 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f64199ad-1580-4a41-997b-8fc86b83d533 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.153035 Sep 01 17:35:55.405577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 258/501] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:55 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:55.554186 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:55.554772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:55.560685 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:55.561155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:55.561608 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:55.562279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:55.562718 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:55.563126 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:55.686954 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:55.694480 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ca539c00-c86b-44a9-81a0-ba632ffc128a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.144164 Sep 01 17:35:55.695029 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 244/502] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:55 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:56.426938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:56.427540 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:56.434025 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:56.434495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:56.434921 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:56.436139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:56.436580 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:56.436990 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:56.566886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:56.574911 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:56.576371 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:56.577543 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7c1b042e-9080-44c4-b829-133b4b2f4373 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.154450 Sep 01 17:35:56.578093 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 259/503] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:56 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:56.715299 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:56.715842 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:56.721785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:56.722260 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:56.722685 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:56.723361 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:56.723810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:56.724225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:56.852481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:56.861174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0d6bc8e9-a604-4993-a294-ec63960aa5b0 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.149989 Sep 01 17:35:56.861761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 245/504] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:56 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:57.600490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:57.601097 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:57.607533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:57.608008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:57.608439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:57.609122 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:57.609598 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:57.610023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:57.735657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:57.743635 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:57.745102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:57.746280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c4cbaf97-3639-4ecb-ba9a-b36ae6249947 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.149716 Sep 01 17:35:57.746823 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 260/505] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:57 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:57.882241 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:57.882799 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:57.889503 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:57.889976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:57.890403 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:57.891083 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:57.891528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:57.891946 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:58.017155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:58.025339 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-bef15088-b196-4aae-9228-f01613a04742 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.146973 Sep 01 17:35:58.026120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 246/506] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:57 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:58.769834 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:58.770443 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:58.777800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:58.778287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:58.778747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:58.780184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:58.780910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:58.781324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:58.918501 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:58.928618 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:58.930323 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:58.931617 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b1cba7a5-4fb3-4433-b800-16e3c16050fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.165722 Sep 01 17:35:58.932303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 261/507] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:58 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:35:59.046880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:59.048124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:59.054646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:59.055697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:59.056240 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:59.057158 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:59.057986 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:59.058593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:59.299716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:35:59.308755 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-96577e1f-8141-4985-bd1e-ceaf5491f81e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.266076 Sep 01 17:35:59.309614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 247/508] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:35:59 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:35:59.435083 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-046f3a15-8148-46c5-b743-deba0d632d64 req-14654064-20e5-4e7f-9bda-674b300c73e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451901e2-e13e-410c-81fc-de147385216c", "tag": "25f3b950-f286-45a5-b8d5-3f23cc196f50"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:35:59.451961 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-046f3a15-8148-46c5-b743-deba0d632d64 req-14654064-20e5-4e7f-9bda-674b300c73e4 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:59.452843 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-046f3a15-8148-46c5-b743-deba0d632d64 req-14654064-20e5-4e7f-9bda-674b300c73e4 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:59.453539 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-046f3a15-8148-46c5-b743-deba0d632d64 req-14654064-20e5-4e7f-9bda-674b300c73e4 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:59.474638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-046f3a15-8148-46c5-b743-deba0d632d64 req-14654064-20e5-4e7f-9bda-674b300c73e4 service nova] Creating event network-changed:25f3b950-f286-45a5-b8d5-3f23cc196f50 for instance 451901e2-e13e-410c-81fc-de147385216c on hv-cinder-85221 Sep 01 17:35:59.481113 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-046f3a15-8148-46c5-b743-deba0d632d64 req-14654064-20e5-4e7f-9bda-674b300c73e4 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051920 Sep 01 17:35:59.482984 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 262/509] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:35:59.955011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:35:59.955643 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:35:59.961708 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:59.962521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:59.962957 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:35:59.963650 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:35:59.964099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:35:59.964706 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:00.202257 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:00.220516 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:00.222285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:00.224000 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9840b2d9-0b21-4834-95fa-060fb8c34f96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.273067 Sep 01 17:36:00.225087 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 248/510] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:35:59 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:00.332912 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:00.334358 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:00.342073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:00.342568 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:00.343001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:00.343716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:00.344168 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:00.344587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:00.484676 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:00.495335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ff9a7d80-26ed-483c-b656-259885b033c1 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.166620 Sep 01 17:36:00.496016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 263/511] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:00 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:01.248728 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:01.249350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:01.255398 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:01.255880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:01.256306 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:01.256991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:01.257468 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:01.257886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:01.404686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:01.413201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:01.414875 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:01.416016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-65725551-d97e-4074-93b8-793716aa6262 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.171945 Sep 01 17:36:01.416565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 249/512] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:01 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:01.522286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:01.522869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:01.530143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:01.530618 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:01.531044 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:01.531933 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:01.532672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:01.533087 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:01.667598 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:01.676199 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-38e2da39-c60c-4e8f-a8d6-b419feefa2f6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.164097 Sep 01 17:36:01.677124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 264/513] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:01 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:02.440579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:02.441418 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:02.447516 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:02.448250 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:02.448753 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:02.449486 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:02.449938 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:02.450360 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:02.596531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:02.598822 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:02.607604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:02.609334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:02.611042 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a5ad0869-c7fe-48bd-a9e0-82a5a4c2c815 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.174413 Sep 01 17:36:02.627922 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 250/514] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:02 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:36:02.696684 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:02.697530 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:02.705572 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:02.706053 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:02.706670 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:02.707344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:02.707795 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:02.708441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:02.872292 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:02.880800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d117d6ca-0fa6-4362-bdc2-7b22688323db tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.187957 Sep 01 17:36:02.893330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 265/515] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:02 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:03.635063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:03.635710 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:03.642189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:03.642700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:03.643140 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:03.643866 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:03.644597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:03.645096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:03.786472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:03.794906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:03.796318 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:03.797603 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4aed00e2-297c-4ab5-946a-c77b10ad104c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.166434 Sep 01 17:36:03.798146 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 251/516] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:03 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:03.902700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:03.903231 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:03.909833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:03.910321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:03.910800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:03.911495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:03.917931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:03.919714 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:04.066367 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:04.079080 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-97da4f7f-6cf0-4bfb-b348-5266808099be tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.180221 Sep 01 17:36:04.079932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 266/517] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:03 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:04.821110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:04.822453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:04.834588 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:04.835358 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:04.836034 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:04.837521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:04.838157 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:04.838811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:05.081908 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:05.090647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:05.092817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:05.093956 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6853fd44-c8d6-44ca-9dd5-305470f0d236 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.277630 Sep 01 17:36:05.109332 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 252/518] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:04 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:05.109541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:05.109541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:05.110188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:05.110391 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:05.111061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:05.112337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:05.113026 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:05.113601 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:05.118045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:05.260869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:05.269109 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a30db00b-5977-47ee-a42e-6d34f0c6d752 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.172916 Sep 01 17:36:05.269774 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 267/519] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:05 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:06.119400 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:06.120682 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:06.127666 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:06.128544 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:06.128841 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:06.129554 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:06.130192 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:06.130855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:06.274310 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:06.282989 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:06.284498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:06.285781 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d105179d-5563-493a-a97f-22d642f1785e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.171033 Sep 01 17:36:06.286337 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 253/520] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:06 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:36:06.290024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:06.291197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:06.301179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:06.301785 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:06.302527 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:06.303501 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:06.304401 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:06.305107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:06.441698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:06.449378 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d36e8274-37d0-45bb-818f-45a97cc66585 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.163130 Sep 01 17:36:06.449939 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 268/521] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:06 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:07.103459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-3e00dc15-3a22-4449-a230-e4d8136beb13 req-a2caa742-9167-43a5-b249-bdc10e05d870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451901e2-e13e-410c-81fc-de147385216c", "name": "network-vif-plugged", "status": "completed", "tag": "25f3b950-f286-45a5-b8d5-3f23cc196f50"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:07.129457 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-3e00dc15-3a22-4449-a230-e4d8136beb13 req-a2caa742-9167-43a5-b249-bdc10e05d870 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:07.130181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-3e00dc15-3a22-4449-a230-e4d8136beb13 req-a2caa742-9167-43a5-b249-bdc10e05d870 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:07.130338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-3e00dc15-3a22-4449-a230-e4d8136beb13 req-a2caa742-9167-43a5-b249-bdc10e05d870 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:07.144618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-3e00dc15-3a22-4449-a230-e4d8136beb13 req-a2caa742-9167-43a5-b249-bdc10e05d870 service nova] Creating event network-vif-plugged:25f3b950-f286-45a5-b8d5-3f23cc196f50 for instance 451901e2-e13e-410c-81fc-de147385216c on hv-cinder-85221 Sep 01 17:36:07.152382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-3e00dc15-3a22-4449-a230-e4d8136beb13 req-a2caa742-9167-43a5-b249-bdc10e05d870 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052963 Sep 01 17:36:07.155510 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 254/522] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:07.308412 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:07.309035 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:07.315665 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:07.316417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:07.317036 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:07.317772 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:07.318458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:07.319096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:07.466870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:07.472040 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:07.472727 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:07.476356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:07.479955 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:07.481390 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e340d910-a61f-4b9b-9701-7e09b53c0858 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.176928 Sep 01 17:36:07.482978 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 269/523] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:07 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:07.499032 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:07.499783 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:07.500233 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:07.500991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:07.501471 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:07.501892 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:07.636528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:07.644350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3c2a1878-762e-4826-8349-a5bed692ac0d tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.177167 Sep 01 17:36:07.644930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 255/524] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:07 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:08.514221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:08.514941 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:08.521869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:08.522426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:08.522928 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:08.523856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:08.524398 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:08.524830 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:08.665392 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:08.666685 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:08.675779 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:08.686485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:08.687932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:08.689470 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:08.690153 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:08.690759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:08.692058 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9a09112e-8a79-4536-970e-37fa20526d7f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.181873 Sep 01 17:36:08.693012 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:08.708511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:08.709134 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 270/525] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:08 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:08.709528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:08.850211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:08.858287 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ed9924c8-0226-470b-863a-a69e06ee66d8 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1362 microversion: 2.1 time: 0.196797 Sep 01 17:36:08.859147 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 256/526] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:08 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:09.716903 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:09.718379 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:09.725121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:09.725708 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:09.726147 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:09.726878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:09.727341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:09.727765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:09.870613 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:09.880234 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:09.880947 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:09.883802 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:09.885621 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:09.886992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0c9205b0-3918-43fd-9514-00d0ceb23c90 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.174488 Sep 01 17:36:09.889044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:09.890292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:09.890983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:09.891927 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:09.892454 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:09.893120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:09.896115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 271/527] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:09 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:10.054815 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:10.064026 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7f8719a6-0599-427d-b582-b247c4abe003 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1551 microversion: 2.1 time: 0.187666 Sep 01 17:36:10.064618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 257/528] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:09 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1551 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:10.088015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:10.089200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:10.097996 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:10.098483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:10.098918 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:10.099628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:10.100080 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:10.100499 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:10.262958 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:10.271650 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-bc6c62fe-4326-495e-b409-d36843211d2f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1551 microversion: 2.1 time: 0.190889 Sep 01 17:36:10.278173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 272/529] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:10 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1551 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:10.291471 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:10.296975 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:10.297757 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Searching by: {'deleted': False, 'project_id': '9644529eb8a94aa39e326871bc7b73e1'} {{(pid=121745) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 17:36:10.304641 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:10.305109 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:10.305562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:10.306276 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:10.306726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:10.307144 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:10.400175 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.multi_cell_list [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121745) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 17:36:10.495582 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2521e87c-ae22-4b55-acbe-0fc5dc4ae757 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.207816 Sep 01 17:36:10.496337 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 258/530] 10.222.0.102 () {58 vars in 1130 bytes} [Thu Sep 1 17:36:10 2022] GET /compute/v2.1/servers => generated 345 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:10.507714 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:10.508443 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:10.515072 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:10.515486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:10.516106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:10.516974 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:10.517626 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:10.518054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:10.840664 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:10.849376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-af482cbb-9ec2-478e-8cd3-915ec86a44bc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1551 microversion: 2.1 time: 0.345665 Sep 01 17:36:10.850462 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 273/531] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:10 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1551 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:10.920792 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:10.921434 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:10.927514 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:10.928034 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:10.928464 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:10.929169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:10.929643 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:10.930072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:11.160389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:11.171244 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:11.174034 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:11.175506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cb25e086-743b-4d55-b5f9-9bc618ca7cfd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.259055 Sep 01 17:36:11.176550 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 259/532] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:10 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:12.199528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:12.200596 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:12.206847 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:12.207327 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:12.207758 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:12.208448 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:12.208902 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:12.209341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:12.342229 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:12.350554 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:12.352056 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:12.353213 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1cc50ac9-69bc-4017-9cf1-0f9718bacb62 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1740 microversion: 2.20 time: 0.157766 Sep 01 17:36:12.353793 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 274/533] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:12 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:13.375796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:13.376394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:13.382680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:13.383255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:13.383785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:13.384664 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:13.385187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:13.385697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:13.490064 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d8d12b54-ddd4-4ba2-8ad6-16fcba3af6a6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f7e5c7c-e3e2-4335-b757-0da7e33f208c"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:13.492471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d8d12b54-ddd4-4ba2-8ad6-16fcba3af6a6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:13.498720 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8d12b54-ddd4-4ba2-8ad6-16fcba3af6a6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:13.499201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8d12b54-ddd4-4ba2-8ad6-16fcba3af6a6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:13.499632 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8d12b54-ddd4-4ba2-8ad6-16fcba3af6a6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:13.500320 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8d12b54-ddd4-4ba2-8ad6-16fcba3af6a6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:13.500778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8d12b54-ddd4-4ba2-8ad6-16fcba3af6a6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:13.501204 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d8d12b54-ddd4-4ba2-8ad6-16fcba3af6a6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:13.517714 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:13.525718 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:13.527137 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:13.528771 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-52f4d957-cd31-4707-8491-3ddecff693b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1722 microversion: 2.20 time: 0.156320 Sep 01 17:36:13.529394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 260/534] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:13 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:14.551896 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:14.552538 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:14.554529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=54 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:14.561254 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:14.561759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:14.562190 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:14.562905 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:14.563356 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:14.563778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:14.689875 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:14.697922 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:14.699360 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:14.700509 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-aabee5c8-c273-4b6d-9715-5c48ec547536 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1722 microversion: 2.20 time: 0.152478 Sep 01 17:36:14.701062 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 261/535] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:14 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:36:14.878366 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-de27a7ee-1163-4043-a874-0d45cadd4489 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:14.878848 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-de27a7ee-1163-4043-a874-0d45cadd4489 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:14.884714 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de27a7ee-1163-4043-a874-0d45cadd4489 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:14.885187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de27a7ee-1163-4043-a874-0d45cadd4489 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:14.885646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de27a7ee-1163-4043-a874-0d45cadd4489 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:14.886314 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de27a7ee-1163-4043-a874-0d45cadd4489 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:14.886755 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de27a7ee-1163-4043-a874-0d45cadd4489 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:14.887165 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de27a7ee-1163-4043-a874-0d45cadd4489 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:14.909775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-de27a7ee-1163-4043-a874-0d45cadd4489 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/ips" status: 200 len: 145 microversion: 2.1 time: 0.035146 Sep 01 17:36:14.910269 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 262/536] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:36:14 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:36:15.045823 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-b95ac2b6-cabf-42be-9d59-e9ddcd821a58 req-55ad9699-5ea8-412c-b8b8-8e99f3b49161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61004bf-b919-4848-8efa-ba83a2a8e633", "name": "network-vif-unplugged", "status": "completed", "tag": "57a21496-3b93-45c7-9205-d2fd2b7131e5"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:15.058308 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-b95ac2b6-cabf-42be-9d59-e9ddcd821a58 req-55ad9699-5ea8-412c-b8b8-8e99f3b49161 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:15.058995 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-b95ac2b6-cabf-42be-9d59-e9ddcd821a58 req-55ad9699-5ea8-412c-b8b8-8e99f3b49161 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:15.059993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-b95ac2b6-cabf-42be-9d59-e9ddcd821a58 req-55ad9699-5ea8-412c-b8b8-8e99f3b49161 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:15.073168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-b95ac2b6-cabf-42be-9d59-e9ddcd821a58 req-55ad9699-5ea8-412c-b8b8-8e99f3b49161 service nova] Creating event network-vif-unplugged:57a21496-3b93-45c7-9205-d2fd2b7131e5 for instance b61004bf-b919-4848-8efa-ba83a2a8e633 on hv-cinder-85221 Sep 01 17:36:15.078791 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-b95ac2b6-cabf-42be-9d59-e9ddcd821a58 req-55ad9699-5ea8-412c-b8b8-8e99f3b49161 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039221 Sep 01 17:36:15.079543 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 263/537] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:15.111934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d8d12b54-ddd4-4ba2-8ad6-16fcba3af6a6 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "POST /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.625534 Sep 01 17:36:15.112632 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 275/538] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:36:13 2022] POST /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments => generated 194 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:36:15.724502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:15.725122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:15.731763 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:15.732243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:15.732666 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:15.733357 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:15.733805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:15.734215 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:15.891735 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:15.905897 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:15.907847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:15.908530 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-eb8605e0-765f-492f-b5c4-55bc3aca9fb1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1725 microversion: 2.20 time: 0.188592 Sep 01 17:36:15.909343 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 264/539] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:15 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:15.933532 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b811c161-d7e0-4f6c-9c34-f06ff7a20739 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d119c4c0-296a-443f-ac09-26e1001f31c0"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:15.936736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b811c161-d7e0-4f6c-9c34-f06ff7a20739 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:15.951353 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b811c161-d7e0-4f6c-9c34-f06ff7a20739 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:15.953409 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b811c161-d7e0-4f6c-9c34-f06ff7a20739 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:15.954537 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b811c161-d7e0-4f6c-9c34-f06ff7a20739 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:15.955804 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b811c161-d7e0-4f6c-9c34-f06ff7a20739 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:15.956755 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b811c161-d7e0-4f6c-9c34-f06ff7a20739 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:15.957467 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b811c161-d7e0-4f6c-9c34-f06ff7a20739 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:16.258812 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b811c161-d7e0-4f6c-9c34-f06ff7a20739 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329712 Sep 01 17:36:16.259455 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 276/540] 10.222.0.102 () {62 vars in 1369 bytes} [Thu Sep 1 17:36:15 2022] POST /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:36:16.383276 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:16.383862 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:16.390235 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:16.390707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:16.391129 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:16.391807 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:16.392258 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:16.392921 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:16.436887 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121745) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 17:36:16.504226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b774fa4a-9a7d-4ec6-8a9a-943d9ad83a48 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/action" status: 202 len: 0 microversion: 2.20 time: 0.124663 Sep 01 17:36:16.505051 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 265/541] 10.222.0.102 () {62 vars in 1324 bytes} [Thu Sep 1 17:36:16 2022] POST /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:36:16.513766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:16.514543 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:16.521068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:16.521579 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:16.522007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:16.522692 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:16.523136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:16.523549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:16.660831 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:16.670511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:16.671962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:16.673124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0a1a9a50-3c0a-492d-9d38-dee91ee1ed35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1751 microversion: 2.20 time: 0.163960 Sep 01 17:36:16.673879 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 277/542] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:16 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:17.041237 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1509a2fc-d7f2-4727-997b-215551df89b4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7bd9581-17b7-4d0e-a725-4ca6c70fda3f"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:17.044059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1509a2fc-d7f2-4727-997b-215551df89b4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:17.050052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1509a2fc-d7f2-4727-997b-215551df89b4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:17.050529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1509a2fc-d7f2-4727-997b-215551df89b4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:17.050955 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1509a2fc-d7f2-4727-997b-215551df89b4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:17.051684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1509a2fc-d7f2-4727-997b-215551df89b4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:17.052132 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1509a2fc-d7f2-4727-997b-215551df89b4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:17.052542 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1509a2fc-d7f2-4727-997b-215551df89b4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:17.353343 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:17.372998 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1509a2fc-d7f2-4727-997b-215551df89b4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338641 Sep 01 17:36:17.373703 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 266/543] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:36:17 2022] POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:17.696319 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:17.696924 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:17.699334 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=54 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:17.705167 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:17.705701 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:17.706157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:17.706845 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:17.707293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:17.707711 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:17.837069 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:17.846347 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:17.847854 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:17.849013 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9134c546-3b05-4a85-9316-1d90de23cdd2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.156595 Sep 01 17:36:17.849599 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 278/544] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:17 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:18.977649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:18.978343 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:18.985024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:18.985549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:18.985991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:18.986675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:18.987128 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:18.987547 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:19.119893 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:19.129096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:19.130565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:19.131708 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-94fa9847-3c07-4daf-8485-004cc0c409de tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.263475 Sep 01 17:36:19.132253 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 267/545] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:18 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:20.154221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:20.154757 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:20.161228 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:20.161739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:20.162176 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:20.162866 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:20.163316 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:20.163735 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:20.291344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:20.294806 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:20.300864 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:20.302330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:20.303602 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2313252b-327d-45dd-86a1-b6169e65b466 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.153211 Sep 01 17:36:20.304256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 279/546] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:20 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:21.327643 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:21.328243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:21.330659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:21.336122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:21.336863 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:21.337296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:21.337994 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:21.338447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:21.338864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:21.467552 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:21.476123 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:21.477591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:21.478772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f409037b-c40f-4f8e-98ce-775eb778ded2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.155517 Sep 01 17:36:21.479326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 268/547] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:21 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:22.502733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:22.503338 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:22.509995 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:36:22.510171 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Thu Sep 1 17:36:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 (ip 10.222.0.102) !!! Sep 01 17:36:22.531133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:22.531829 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:22.532243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:22.534381 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:22.534852 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:22.535282 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:22.668051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:22.677236 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:22.678713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:22.679867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-57f3e646-83c3-475f-9334-024befe75f39 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.181775 Sep 01 17:36:22.689337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 280/548] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:22 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:23.708952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:23.709579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:23.716153 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:23.716624 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:23.717047 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:23.717747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:23.718189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:23.718601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:23.759889 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:23.760498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:23.767080 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:23.767560 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:23.767992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:23.768685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:23.769361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:23.769766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:23.855247 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:23.865035 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:23.866520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:23.867777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8ff06c8b-557d-49df-83ba-4440aa75a6a0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.162865 Sep 01 17:36:23.868988 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 269/549] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:23 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:23.907119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:23.915359 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c29dc0d2-f911-4397-9eb2-6ab1e1295b61 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1597 microversion: 2.1 time: 0.159291 Sep 01 17:36:23.915917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 281/550] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:23 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:24.891661 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:24.892356 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:24.900321 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:24.900879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:24.901425 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:24.902212 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:24.902726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:24.903238 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:25.039131 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:25.047006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:25.049696 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:25.051158 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c1f5fcb7-cdef-4e26-af20-b70dde16b8aa tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.164277 Sep 01 17:36:25.051937 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 270/551] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:24 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:25.518346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-92420663-4e64-4fa5-bb7a-04c93a11ab12 req-58b91b86-5e2a-497e-a06e-9d44ebd2075c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451901e2-e13e-410c-81fc-de147385216c", "tag": "25f3b950-f286-45a5-b8d5-3f23cc196f50"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:25.528312 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-92420663-4e64-4fa5-bb7a-04c93a11ab12 req-58b91b86-5e2a-497e-a06e-9d44ebd2075c service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:25.528791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-92420663-4e64-4fa5-bb7a-04c93a11ab12 req-58b91b86-5e2a-497e-a06e-9d44ebd2075c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:25.529221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-92420663-4e64-4fa5-bb7a-04c93a11ab12 req-58b91b86-5e2a-497e-a06e-9d44ebd2075c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:25.541626 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-92420663-4e64-4fa5-bb7a-04c93a11ab12 req-58b91b86-5e2a-497e-a06e-9d44ebd2075c service nova] Creating event network-changed:25f3b950-f286-45a5-b8d5-3f23cc196f50 for instance 451901e2-e13e-410c-81fc-de147385216c on hv-cinder-85221 Sep 01 17:36:25.546889 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-92420663-4e64-4fa5-bb7a-04c93a11ab12 req-58b91b86-5e2a-497e-a06e-9d44ebd2075c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032208 Sep 01 17:36:25.547736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 282/552] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:26.076679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:26.077989 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:26.084974 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:26.085780 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:26.086529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:26.087285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:26.087834 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:26.088385 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:26.374890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:26.384525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:26.385799 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:26.388110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c4e1f3d3-1bc8-4a3c-86d2-ddf3caa8174a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.316750 Sep 01 17:36:26.390028 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 271/553] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:26 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:36:26.774067 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1524920376"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:26.774688 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:26.780780 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:26.781262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:26.781759 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:26.782448 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:26.782904 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:26.783328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:26.908075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.network.security_group_api [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Adding security group bc5ff52f-cef3-4335-b2f1-54b99f1ef1ae to port 25f3b950-f286-45a5-b8d5-3f23cc196f50 Sep 01 17:36:27.412056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:27.412659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:27.419496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:27.420213 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:27.420718 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:27.421498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:27.421949 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:27.422365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:27.457240 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ab874cda-7fb6-4b0d-bec4-07a7396d4cb5 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "POST /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/action" status: 202 len: 0 microversion: 2.1 time: 0.687960 Sep 01 17:36:27.458322 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 283/554] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:36:26 2022] POST /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:36:27.469145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:27.469145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:27.474094 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:27.474582 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:27.475013 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:27.475706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:27.476159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:27.476589 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:27.566621 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:27.576701 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:27.578154 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:27.579305 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-112dfc44-e3be-4cfd-92c4-3eb691cc05b9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.171191 Sep 01 17:36:27.579845 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 272/555] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:27 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:36:27.584671 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-1107c71c-b618-44ef-888f-973da3f7e4c8 req-a46c3eeb-fe16-44c8-99be-a1025c9a9644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451901e2-e13e-410c-81fc-de147385216c", "tag": "25f3b950-f286-45a5-b8d5-3f23cc196f50"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:27.596750 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-1107c71c-b618-44ef-888f-973da3f7e4c8 req-a46c3eeb-fe16-44c8-99be-a1025c9a9644 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:27.597228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-1107c71c-b618-44ef-888f-973da3f7e4c8 req-a46c3eeb-fe16-44c8-99be-a1025c9a9644 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:27.597702 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-1107c71c-b618-44ef-888f-973da3f7e4c8 req-a46c3eeb-fe16-44c8-99be-a1025c9a9644 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:27.609373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-1107c71c-b618-44ef-888f-973da3f7e4c8 req-a46c3eeb-fe16-44c8-99be-a1025c9a9644 service nova] Creating event network-changed:25f3b950-f286-45a5-b8d5-3f23cc196f50 for instance 451901e2-e13e-410c-81fc-de147385216c on hv-cinder-85221 Sep 01 17:36:27.615106 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-1107c71c-b618-44ef-888f-973da3f7e4c8 req-a46c3eeb-fe16-44c8-99be-a1025c9a9644 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033790 Sep 01 17:36:27.615857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 273/556] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:27.650315 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:27.659152 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-171e2d20-e73f-470e-9aec-f210e3d772fd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1763 microversion: 2.1 time: 0.196181 Sep 01 17:36:27.659717 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 284/557] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:27 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1763 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:28.604375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:28.605071 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:28.611195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:28.611672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:28.612104 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:28.612786 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:28.613240 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:28.613699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:28.742847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:28.752634 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:28.754110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:28.755279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b19a15f5-99d0-4aff-8d76-b9476aaefc04 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.155772 Sep 01 17:36:28.755841 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 274/558] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:28 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:29.778663 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:29.779293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:29.786546 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:29.787186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:29.787624 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:29.788340 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:29.788936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:29.789229 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:29.922860 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:29.933933 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:29.935384 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:29.936567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a5e9b2c7-e88a-4d47-b34a-4a62a397af4e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.162387 Sep 01 17:36:29.937136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 285/559] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:29 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:30.222556 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c78e45a9-9dec-4894-8d3e-74c20db0e3e8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:30.228978 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c78e45a9-9dec-4894-8d3e-74c20db0e3e8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:30.229505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c78e45a9-9dec-4894-8d3e-74c20db0e3e8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:30.230431 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c78e45a9-9dec-4894-8d3e-74c20db0e3e8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:30.289532 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c78e45a9-9dec-4894-8d3e-74c20db0e3e8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Going to try to stop instance {{(pid=121745) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 17:36:30.332467 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c78e45a9-9dec-4894-8d3e-74c20db0e3e8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/action" status: 202 len: 0 microversion: 2.1 time: 0.113744 Sep 01 17:36:30.333329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 275/560] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:36:30 2022] POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:36:30.341851 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:30.342464 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:30.348336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:30.348818 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:30.349352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:30.350035 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:30.350483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:30.350906 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:30.484270 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:30.492473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2cea0f23-e89e-4ca0-9f54-10ff5a6b5c05 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.154476 Sep 01 17:36:30.493037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 286/561] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:30 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:30.961016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:30.961687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:30.968309 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:30.968788 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:30.969266 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:30.969964 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:30.970411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:30.970830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:31.119620 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:31.128910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:31.130360 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:31.131501 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-79d1802b-4c33-408c-8a96-0fd7bcb05df4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1753 microversion: 2.20 time: 0.175232 Sep 01 17:36:31.132038 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 276/562] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:30 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:31.515258 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:31.515775 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:31.522242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:31.522718 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:31.523144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:31.523820 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:31.524264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:31.524677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:31.650611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:31.659781 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-abbb8ca9-abc8-4c95-b9a9-5208bd8dd436 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.148853 Sep 01 17:36:31.660653 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 287/563] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:31 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:32.154987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:32.155705 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:32.162309 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:32.162796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:32.163273 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:32.163955 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:32.164406 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:32.164828 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:32.368535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:32.377290 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:32.378756 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:32.380010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-69384f53-dc51-4df1-b87f-0545952ba53b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.229394 Sep 01 17:36:32.380563 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 277/564] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:32 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:32.680679 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:32.681289 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:32.687823 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:32.688307 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:32.688744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:32.689471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:32.689986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:32.690415 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:32.829103 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:32.837932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-97742701-eade-42b4-b44a-8b4be7f499cb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.161035 Sep 01 17:36:32.838503 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 288/565] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:32 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:33.402706 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:33.403314 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:33.409858 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:33.410334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:33.410758 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:33.411438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:33.411882 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:33.412293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:33.548126 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:33.556607 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:33.558802 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:33.559934 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d073fd0f-f8d3-42b9-94b2-e94bb2d6d933 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.161139 Sep 01 17:36:33.560510 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 278/566] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:33 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:33.860209 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:33.860976 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:33.869041 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:33.869690 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:33.870175 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:33.871050 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:33.871658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:33.872144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:34.015547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:34.023698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-03cad5d2-3fad-42c8-b8cc-ff5519a6c79a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.167365 Sep 01 17:36:34.024258 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 289/567] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:33 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:34.582451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:34.583064 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:34.590133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:34.590728 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:34.591322 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:34.592200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:34.592821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:34.593466 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:34.737625 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:34.747336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:34.748787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:34.750000 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-80aee57b-20cf-4956-b5a4-512e9df2e647 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.171724 Sep 01 17:36:34.750875 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 279/568] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:34 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:35.046655 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:35.048546 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:35.061681 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:35.062417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:35.063007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:35.063905 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:35.064369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:35.064788 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:35.199773 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:35.207940 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c43cdcb5-7a36-4ccc-8665-89075fed6183 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.166282 Sep 01 17:36:35.208508 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 290/569] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:35 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:35.772169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:35.772846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:35.780082 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:35.780566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:35.781002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:35.781719 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:35.782170 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:35.782591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:36.145057 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:36.154447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:36.156534 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:36.157958 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-62d1106d-aa70-456f-a35b-31ee41bca78d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.389773 Sep 01 17:36:36.159021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 280/570] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:35 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:36.230236 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:36.230843 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:36.237436 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:36.237915 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:36.238339 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:36.239026 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:36.239474 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:36.239893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:36.377726 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:36.386553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3ae6766d-bbfd-451a-a6c1-12bdf432fd76 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.160648 Sep 01 17:36:36.387132 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 291/571] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:36 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:37.179961 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:37.180586 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:37.187937 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:37.188433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:37.188865 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:37.189699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:37.190411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:37.190843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:37.328098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:37.337331 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:37.338768 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:37.339975 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f8c2e101-8c60-4bd4-94bf-41f38ca96011 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.163888 Sep 01 17:36:37.340527 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 281/572] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:37 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:37.407717 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:37.408334 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:37.414700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:37.415182 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:37.415615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:37.416299 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:37.416746 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:37.417164 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:37.555486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:37.564160 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-798d60fa-e36d-44a7-a4ee-ae7cf1d85e9c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.160379 Sep 01 17:36:37.564713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 292/573] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:37 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:38.365722 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:38.366331 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:38.374288 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:38.374913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:38.375352 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:38.376075 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:38.376527 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:38.377124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:38.513002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:38.515342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:38.522993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:38.524411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:38.525585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7e41486a-7d5d-427f-b693-8e8c51904c33 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.165186 Sep 01 17:36:38.526125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 282/574] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:38 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:38.586430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:38.587096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:38.594609 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:38.595096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:38.595555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:38.596253 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:38.596708 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:38.597133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:38.735949 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:38.744166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-94070c8f-7d26-4582-a293-6ec1e77c9c4a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.162075 Sep 01 17:36:38.744713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 293/575] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:38 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:39.549796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:39.550528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:39.557890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:39.558865 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:39.559293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:39.559970 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:39.560411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:39.560829 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:39.694239 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:39.703382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:39.704785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:39.705940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5ec9fd7e-78a7-47de-be0d-4d3ea319d99a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.160717 Sep 01 17:36:39.706482 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 283/576] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:39 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:39.767861 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:39.769511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:39.776874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:39.777758 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:39.778558 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:39.779873 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:39.780853 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:39.781767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:39.922570 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:39.931166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b4bf29bf-9f0d-433d-8278-b686e1f5c3e7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.168518 Sep 01 17:36:39.933613 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 294/577] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:39 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:40.730565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:40.731348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:40.737983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:40.738460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:40.738881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:40.739670 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:40.740122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:40.740537 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:40.879896 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:40.891054 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:40.893159 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:40.894532 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e6c7914a-3b46-43de-bede-d66a1e8dbce8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.168545 Sep 01 17:36:40.909981 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 284/578] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:40 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:40.951982 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:40.952563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:40.958925 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:40.959433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:40.959857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:40.960812 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:40.961258 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:40.961696 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:41.092687 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:41.101143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f66452b1-9c2b-45fa-b3f6-e3c3a13fd2a8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.153004 Sep 01 17:36:41.101952 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 295/579] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:40 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:41.919092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:41.919721 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:41.926112 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:41.926582 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:41.927008 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:41.927677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:41.928118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:41.928530 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:42.061050 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:42.069882 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:42.071251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:42.072395 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-98d41b45-1a2e-40b9-b5e5-f0569e5e8dfc tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.157275 Sep 01 17:36:42.072945 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 285/580] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:41 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:42.123929 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:42.124536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:42.131195 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:42.131672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:42.132102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:42.132784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:42.133244 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:42.133699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:42.275074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:42.284034 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f72ff930-e3e1-4e1f-9da7-dadeace97951 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.163944 Sep 01 17:36:42.284603 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 296/581] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:42 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:43.095474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:43.096182 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:43.102771 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:43.103326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:43.103837 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:43.104616 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:43.105743 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:43.106171 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:43.242293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:43.251320 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:43.252737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:43.253907 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-29a0f1ba-0af3-4e80-bb83-b55a1611b2a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.162422 Sep 01 17:36:43.254462 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 286/582] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:43 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:43.304818 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:43.305465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:43.312635 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:43.313115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:43.313589 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:43.314273 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:43.314719 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:43.315133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:43.332450 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:43.446637 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:43.455229 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2c361b86-7597-4b4a-9094-f352ddfa012d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.154176 Sep 01 17:36:43.455797 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 297/583] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:43 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:44.276664 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:44.277236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:44.283594 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:44.284075 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:44.284505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:44.285184 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:44.285668 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:44.286085 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:44.420064 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:44.429554 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:44.430985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:44.432151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b496143c-ce0f-4adf-a5d5-2e775440af94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.159537 Sep 01 17:36:44.432701 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 287/584] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:44 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:44.480431 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:44.481030 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:44.487449 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:44.487930 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:44.488359 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:44.489047 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:44.489540 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:44.489961 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:44.629745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:44.637999 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ee0633b9-43ff-4b1c-ac04-f6de19ab15ba tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.161928 Sep 01 17:36:44.638554 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 298/585] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:44 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:45.455089 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:45.455884 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:45.458138 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:45.463564 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:45.464676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:45.465130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:45.465848 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:45.466330 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:45.466738 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:45.607776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:45.616381 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:45.617836 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:45.618987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-365cfbd2-78f7-42b9-94f7-41f18111d80a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.167885 Sep 01 17:36:45.619538 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 288/586] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:45 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:45.658376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:45.658964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:45.665086 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:45.665585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:45.666017 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:45.666694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:45.667137 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:45.667545 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:45.796045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:45.804224 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-426be43e-ef8a-4582-900f-f3e3e2ac6c21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.149661 Sep 01 17:36:45.804780 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 299/587] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:45 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:46.641561 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:46.642166 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:46.648602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:46.649079 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:46.649547 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:46.650237 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:46.650685 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:46.651102 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:46.786784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:46.795384 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:46.796802 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:46.797997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ec2f52bc-fdfc-45e9-94db-546a1f6f21f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.160330 Sep 01 17:36:46.798548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 289/588] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:46 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:46.826811 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:46.827453 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:46.834147 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:46.834626 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:46.835302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:46.836047 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:46.836494 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:46.836945 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:46.967641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:46.975886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fcdf4a57-7525-4d34-a8a9-33da537777fd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.153990 Sep 01 17:36:46.976445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 300/589] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:46 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:47.822284 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:47.822914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:47.828890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:47.829426 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:47.829853 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:47.830525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:47.830975 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:47.831391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:47.956491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:47.965735 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:47.967160 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:47.968293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5173cd62-26ee-4c18-960c-5c0f470c8921 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.150064 Sep 01 17:36:47.968846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 290/590] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:47 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:47.995873 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:47.996485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:47.998789 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=46 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:48.004031 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:48.004518 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:48.004954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:48.005683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:48.006127 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:48.006551 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:48.140262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:48.148904 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c5df611a-fe3f-4301-a915-2744bf73ebc9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.156888 Sep 01 17:36:48.149508 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 301/591] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:47 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:48.921833 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8c09f85f-4925-4f59-83af-65b01f81e050 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d758e0ba-b682-4b85-a7f6-a3ce32de01a9"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:48.924200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8c09f85f-4925-4f59-83af-65b01f81e050 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:48.930200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c09f85f-4925-4f59-83af-65b01f81e050 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:48.930679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c09f85f-4925-4f59-83af-65b01f81e050 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:48.931111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c09f85f-4925-4f59-83af-65b01f81e050 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:48.931786 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c09f85f-4925-4f59-83af-65b01f81e050 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:48.932257 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c09f85f-4925-4f59-83af-65b01f81e050 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:48.932677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8c09f85f-4925-4f59-83af-65b01f81e050 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:48.991347 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:48.992001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:48.998505 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:48.999080 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:48.999435 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:49.000149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:49.000649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:49.001075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:49.130331 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:49.139136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:49.140579 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:49.141775 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-069df986-f3ea-4f08-a440-4225f8bfc122 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.154544 Sep 01 17:36:49.142495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 302/592] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:48 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:36:49.170627 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:49.171169 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:49.176881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:49.177395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:49.177833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:49.178545 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:49.178997 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:49.179419 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:49.308716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:49.317043 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0f1357bf-05d2-4f69-a572-0535b0a0e95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1726 microversion: 2.1 time: 0.150524 Sep 01 17:36:49.317637 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 303/593] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:49 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:36:49.897636 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8c09f85f-4925-4f59-83af-65b01f81e050 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.077776 Sep 01 17:36:49.898229 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 291/594] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:36:48 2022] POST /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments => generated 194 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:36:50.165827 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:50.166369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:50.172696 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:50.173166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:50.173629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:50.174304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:50.174747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:50.175163 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:50.301375 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:50.311096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:50.312526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:50.313693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-26637052-c770-4074-99a7-f2d7d37a04c1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.151982 Sep 01 17:36:50.314248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 304/595] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:50 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:50.339297 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:50.339986 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:50.346151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:50.346623 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:50.347048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:50.347742 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:50.348188 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:50.348599 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:50.477924 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:50.486632 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3333d131-71d7-4177-8d10-babd99cba925 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1703 microversion: 2.1 time: 0.152164 Sep 01 17:36:50.487181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 292/596] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:50 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1703 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:50.507736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b30986c4-f5f2-48c2-bf1f-38be77cce95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:36:50.514397 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b30986c4-f5f2-48c2-bf1f-38be77cce95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:50.514886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b30986c4-f5f2-48c2-bf1f-38be77cce95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:50.515335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b30986c4-f5f2-48c2-bf1f-38be77cce95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:50.575660 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b30986c4-f5f2-48c2-bf1f-38be77cce95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Going to try to start instance {{(pid=121744) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 17:36:50.615611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b30986c4-f5f2-48c2-bf1f-38be77cce95a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/action" status: 202 len: 0 microversion: 2.1 time: 0.111960 Sep 01 17:36:50.616192 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 305/597] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:36:50 2022] POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:36:50.624843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:50.625485 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:50.631381 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:50.631860 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:50.632292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:50.632969 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:50.633454 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:50.633883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:50.759961 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:50.768064 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5fe6d25b-642d-4657-8bfb-99bc947ea335 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1712 microversion: 2.1 time: 0.147593 Sep 01 17:36:50.768622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 293/598] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:50 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:51.338073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:51.338798 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:51.345687 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:51.346171 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:51.346606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:51.347291 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:51.347742 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:51.348168 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:51.476366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:51.484971 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:51.486490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:51.487638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-89b0dac1-eeb7-43d4-9f46-17328e4a91d6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.154700 Sep 01 17:36:51.488196 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 306/599] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:51 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:51.789737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:51.790597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:51.805068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:51.805601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:51.806124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:51.807323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:51.808457 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:51.808883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:52.037219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:52.046898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ecd7fe58-26c7-419b-ac86-1bb1b7a5d726 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1712 microversion: 2.1 time: 0.260869 Sep 01 17:36:52.058624 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 294/600] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:51 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1712 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:52.510091 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:52.510695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:52.517214 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:52.517730 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:52.518157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:52.518862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:52.519316 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:52.519735 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:52.649782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:52.658764 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:52.660188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:52.661342 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c9f16a59-e513-4763-8953-d7a99c138f8f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.155128 Sep 01 17:36:52.661910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 307/601] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:52 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:53.069484 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:53.070007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:53.076914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:53.077413 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:53.077843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:53.078520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:53.078963 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:53.079535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:53.213291 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:53.222027 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-dea58973-8ca7-487a-b175-c9aebb61520a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1712 microversion: 2.1 time: 0.156534 Sep 01 17:36:53.222581 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 295/602] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:53 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1712 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:53.683850 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:53.684424 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:53.690921 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:53.691395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:53.691817 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:53.692491 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:53.692936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:53.693371 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:53.831638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:53.840473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:53.841945 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:53.843096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-35c7e670-92e6-434d-9e5e-e72632e43037 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.163118 Sep 01 17:36:53.853558 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 308/603] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:53 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:54.243506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:54.244122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:54.251098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:54.251579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:54.252017 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:54.252704 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:54.253157 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:54.253602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:54.381015 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:54.389768 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-81462a6c-1e78-4d51-b9f0-4d0cf0e9d65d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1716 microversion: 2.1 time: 0.150057 Sep 01 17:36:54.390419 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 296/604] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:36:54 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:36:54.867279 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:54.867913 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:54.874926 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:54.875398 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:54.875825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:54.876529 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:54.876977 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:54.877420 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:55.008336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:55.017364 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:55.018791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:55.019933 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8dcbd329-d101-4d06-aaef-8bb60f78f45b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.156628 Sep 01 17:36:55.020485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 309/605] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:54 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:56.043707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:56.044303 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:56.050754 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:56.051226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:56.051650 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:56.052322 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:56.052764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:56.053173 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:56.186135 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:56.194707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:56.196140 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:56.197285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-31c68675-27ca-4d23-a5fd-6a39e728325e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.157933 Sep 01 17:36:56.197867 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 297/606] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:56 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:36:57.220362 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:57.220893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:57.227470 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:57.227942 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:57.228367 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:57.229592 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:57.230042 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:57.230456 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:57.361359 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:57.370512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:57.371927 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:57.373057 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-851a5e64-35e8-4a02-aaa5-c5d32c942dfe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.156709 Sep 01 17:36:57.373699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 310/607] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:57 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:58.395761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:58.396375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:58.402855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:58.403344 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:58.403774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:58.404466 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:58.404918 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:58.405362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:58.408206 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:36:58.533862 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:58.542541 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:58.543972 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:58.545123 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cc0bd8ea-c784-490c-b496-e13d163c8cba tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.153176 Sep 01 17:36:58.545722 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 298/608] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:58 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:36:59.567713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:36:59.568368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:36:59.575601 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:59.576086 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:59.576517 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:59.577219 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:36:59.577697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:36:59.578116 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:36:59.708032 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:59.717565 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:59.718987 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:36:59.720132 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2726f934-0b86-4563-8a5c-ab7a39717907 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.156354 Sep 01 17:36:59.720685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 311/609] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:36:59 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:00.590941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:00.593291 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:00.599751 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.600231 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.600667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.601365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.601815 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.602231 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.624760 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lazy-loading 'flavor' on Instance uuid eea8f35b-6c91-4f1c-8671-1b47c2e93e20 {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:37:00.742870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:00.743511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:00.749992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.750461 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.750881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.751641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.752086 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.752504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.787236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4989ba76-e7fe-4bbe-90c9-ab445c3739a0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/action" status: 200 len: 32 microversion: 2.1 time: 0.200701 Sep 01 17:37:00.787825 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 299/610] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:37:00 2022] POST /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:37:00.798055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:00.798746 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:00.805248 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.805745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.806227 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.808488 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:00.808488 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:00.808488 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:00.886921 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:00.895672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:00.897101 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:00.898279 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a49606c2-9a0e-4c4a-9ba3-bf054bf202b1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.159609 Sep 01 17:37:00.898834 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 312/611] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:00 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:01.028023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:01.036171 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7c95143f-b295-4c51-ac17-64af10bf2f43 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.242175 Sep 01 17:37:01.036737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 300/612] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:00 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:01.486974 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-f52453a0-0861-427c-a2b1-d49e54e81701 req-256d4f9b-5fcd-46cb-9855-8c3cb8745190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61004bf-b919-4848-8efa-ba83a2a8e633", "name": "network-vif-plugged", "status": "completed", "tag": "57a21496-3b93-45c7-9205-d2fd2b7131e5"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:01.497790 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f52453a0-0861-427c-a2b1-d49e54e81701 req-256d4f9b-5fcd-46cb-9855-8c3cb8745190 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:01.498272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f52453a0-0861-427c-a2b1-d49e54e81701 req-256d4f9b-5fcd-46cb-9855-8c3cb8745190 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:01.498702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f52453a0-0861-427c-a2b1-d49e54e81701 req-256d4f9b-5fcd-46cb-9855-8c3cb8745190 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:01.502990 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:01.510671 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-f52453a0-0861-427c-a2b1-d49e54e81701 req-256d4f9b-5fcd-46cb-9855-8c3cb8745190 service nova] Creating event network-vif-plugged:57a21496-3b93-45c7-9205-d2fd2b7131e5 for instance b61004bf-b919-4848-8efa-ba83a2a8e633 on hv-cinder-85221 Sep 01 17:37:01.516191 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-f52453a0-0861-427c-a2b1-d49e54e81701 req-256d4f9b-5fcd-46cb-9855-8c3cb8745190 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095999 Sep 01 17:37:01.516781 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 313/613] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:01.922055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:01.922659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:01.929058 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:01.929567 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:01.929997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:01.930679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:01.931126 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:01.931544 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:02.057712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:02.058326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:02.058567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:02.067305 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:02.067475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:02.067764 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:02.068203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:02.068674 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:02.068922 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:02.069397 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:02.069840 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:02.069949 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-01d0074b-f8a7-4126-b6b9-ea601ac3646a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.152351 Sep 01 17:37:02.070448 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 301/614] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:01 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:02.214758 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:02.224262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f467b3e3-cc05-421d-89bf-d269eff52152 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.171907 Sep 01 17:37:02.224820 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 314/615] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:02 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:03.092890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:03.093468 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:03.099840 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.100321 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.100783 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.101531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.101958 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.102376 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.231841 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:03.240467 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:03.241940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:03.243083 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6ef323a5-8eca-4928-9524-5eb84bf8099d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.154218 Sep 01 17:37:03.243623 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 302/616] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:03 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:03.245119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:03.246476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:03.252860 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.253402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.253840 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.254532 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:03.254992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:03.255416 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:03.386712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:03.395001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-361a6ab5-9a4e-4748-8880-b991f373779c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.153782 Sep 01 17:37:03.395556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 315/617] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:03 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:04.265898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:04.266507 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:04.273737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.274222 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.274652 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:04.275347 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.275895 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.276320 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:04.411536 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:04.416027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:04.416637 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:04.421849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:04.423159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.423426 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:04.423655 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.424116 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:04.424665 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f209b029-1a86-4830-9d36-5bd8f11c6e2f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1809 microversion: 2.20 time: 0.162608 Sep 01 17:37:04.424835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:04.425135 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 303/618] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:04 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:04.425277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:04.425617 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:04.564634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:04.572998 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d45d36f5-9c2c-422a-8c55-3c478a439247 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.161336 Sep 01 17:37:04.574139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 316/619] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:04 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:05.447770 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:05.448302 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:05.455354 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:05.455826 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:05.456248 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:05.456924 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:05.457386 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:05.457798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:05.584453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:05.593934 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:05.595351 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:05.596073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:05.596544 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ff994f35-59f5-4d5c-8111-7370d9d783e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1796 microversion: 2.20 time: 0.152683 Sep 01 17:37:05.596685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:05.597011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 304/620] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:37:05 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1796 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:37:05.603029 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:05.603507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:05.603939 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:05.604665 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:05.605131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:05.605572 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:05.737074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:05.745391 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-00dd09f9-66c9-4083-8471-2787531c307b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.153088 Sep 01 17:37:05.745924 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 317/621] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:05 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:06.765930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:06.766448 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:06.772900 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:06.773411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:06.773846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:06.774526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:06.774975 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:06.775392 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:06.904460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:06.912601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0ef89b64-5b61-407c-90d6-1070104c9d7d tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.150618 Sep 01 17:37:06.913162 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 305/622] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:06 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:07.933296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:07.933956 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:07.940278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:07.940750 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:07.941172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:07.941870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:07.942317 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:07.942730 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:08.070220 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:08.078838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-497e6365-0214-4594-a069-86af91873e16 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.149389 Sep 01 17:37:08.079389 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 318/623] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:07 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:09.099731 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:09.100262 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:09.106664 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:09.107137 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:09.107567 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:09.108241 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:09.108686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:09.109101 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:09.236955 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:09.245815 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f843de5d-97a8-45e0-806b-ffa1ed764c0b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.149302 Sep 01 17:37:09.246366 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 306/624] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:09 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:10.266635 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:10.267152 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:10.273678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:10.274157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:10.274593 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:10.275278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:10.275729 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:10.276261 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:10.405270 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:10.413391 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0ffd36c1-7f52-495a-aba5-8eaef0623558 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.150727 Sep 01 17:37:10.413946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 319/625] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:10 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:11.434081 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:11.434709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:11.441022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:11.441526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:11.441948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:11.442621 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:11.443063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:11.443477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:11.568534 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:11.577171 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c4e5d180-9bfa-4dd8-8633-a1c0d0487fbf tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.146894 Sep 01 17:37:11.577777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 307/626] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:11 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:12.598822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:12.599422 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:12.605507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:12.605978 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:12.606401 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:12.607070 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:12.607512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:12.607924 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:12.736401 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:12.744515 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9b758818-fc46-42d5-9876-799cc6b98bab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.149534 Sep 01 17:37:12.745590 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 320/627] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:12 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:13.766614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:13.767197 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:13.773643 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:13.774121 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:13.774547 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:13.775218 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:13.775660 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:13.776072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:13.905287 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:13.913475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-26667901-5a86-497c-b925-bf50b991d7db tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.150672 Sep 01 17:37:13.914027 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 308/628] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:13 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:14.934243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:14.934766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:14.941531 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:14.942023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:14.942986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:14.943686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:14.944145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:14.944570 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:15.084120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:15.094059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-072e1844-0ebf-40e2-bcaa-add60c5bb55b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.163888 Sep 01 17:37:15.094622 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 321/629] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:14 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:16.115502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:16.116105 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:16.118524 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=42 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:16.124754 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:16.125230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:16.125710 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:16.126391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:16.126870 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:16.127289 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:16.258274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:16.266443 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-79ea9c68-ed18-429a-bf4e-773c93467fe8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.154791 Sep 01 17:37:16.267010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 309/630] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:16 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:17.287841 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:17.288386 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:17.295430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:17.295905 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:17.296358 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:17.297045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:17.297527 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:17.297979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:17.426904 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:17.435076 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0cc129ae-ba16-4ae3-bad3-ffdaaf8d53d8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.151217 Sep 01 17:37:17.435627 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 322/631] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:17 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:18.456006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:18.456724 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:18.464169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:18.464656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:18.465090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:18.465809 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:18.466261 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:18.466684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:18.594765 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:18.602891 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1a2ee31f-f445-49bb-89c5-e774797b412c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.150830 Sep 01 17:37:18.603444 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 310/632] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:18 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:19.623075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:19.623687 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:19.626132 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=44 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:19.631737 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:19.632223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:19.632659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:19.633365 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:19.633822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:19.634245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:19.762527 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:19.771599 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2d759c21-aabf-4eed-95cf-7b7f67824475 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.152081 Sep 01 17:37:19.772171 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 323/633] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:19 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:20.793453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:20.794023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:20.800697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:20.801175 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:20.801628 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:20.802310 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:20.802759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:20.803177 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:20.933431 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:20.941627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-bdcf4974-a623-4cce-8310-542ebdf34e38 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.152650 Sep 01 17:37:20.942190 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 311/634] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:20 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:21.961696 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:21.962301 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:21.969221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:21.969728 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:21.970162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:21.970841 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:21.971289 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:21.971705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:22.100165 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:22.108937 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d63a63a1-0601-4570-a5ea-5f3ea282b6ce tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.151377 Sep 01 17:37:22.109516 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 324/635] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:21 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:23.131020 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:23.131553 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:23.138677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:23.139154 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:23.139586 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:23.140269 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:23.140724 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:23.141146 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:23.273699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:23.275883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:23.283162 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-73a160d5-be51-42da-8e6f-35ee9d142177 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.156140 Sep 01 17:37:23.283711 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 312/636] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:23 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:24.303751 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:24.304361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:24.311357 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.311931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.312427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.313104 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:24.313578 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:24.313996 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:24.443280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:24.453051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2e4c368d-2245-4c68-8065-012321c46c92 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.153081 Sep 01 17:37:24.453645 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 325/637] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:24 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:25.475367 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:25.475976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:25.484590 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:25.485065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:25.485526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:25.486209 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:25.486659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:25.487078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:25.613881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:25.621942 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5cd992c0-8ad8-46f3-9388-7c47e7e476a4 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1740 microversion: 2.1 time: 0.150436 Sep 01 17:37:25.622493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 313/638] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:25 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:26.643894 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:26.644504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:26.651102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.651587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.652024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.652709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.653217 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.653851 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.779802 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:26.787982 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1c98cb46-ebd2-4dfe-82f4-06cc93366bdd tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1720 microversion: 2.1 time: 0.148682 Sep 01 17:37:26.788547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 326/639] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:26 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:26.846920 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:26.847481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:26.854639 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.855120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.855554 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.856246 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.856697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.857118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:26.980427 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] HTTP exception thrown: Cannot 'detach_volume' instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 while it is in vm_state rescued Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Request method failure captured: Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: DELETE /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments/d758e0ba-b682-4b85-a7f6-a3ce32de01a9 HTTP/1.1 Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxmaj4UJdfALJiK6W9WL56J0LdsNmogXNfbKS_awQ7no9izWJEl9HWo6Ush6H19mJYyYDfxKKkamKzF82tUc5Tu2yX8ZDJ9rNQwbMa2Na4mJPZDvYqNumOFEJJ1x14D5tKji2TeaJZUgIGvH6LP_eUoyrI7Q-zAjvyRnIuZd2f_3Y8 Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:37:26.981987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_79c90aaff0a44b278807167fdbd38e48", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}] Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: d364c74791fc4cd4af6773433a7a13cc Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:37:26.983597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Cannot 'detach_volume' instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 while it is in vm_state rescued Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'server_id': 'eea8f35b-6c91-4f1c-8671-1b47c2e93e20', 'id': 'd758e0ba-b682-4b85-a7f6-a3ce32de01a9'} Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:37:26.984362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 while it is in vm_state rescued Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 while it is in vm_state rescued Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:26.985654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Returning 409 to user: Cannot 'detach_volume' instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 while it is in vm_state rescued {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:37:26.986605 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0993c902-70bc-4cf0-9875-dcc6fd8a02fb tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "DELETE /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments/d758e0ba-b682-4b85-a7f6-a3ce32de01a9" status: 409 len: 152 microversion: 2.1 time: 0.140541 Sep 01 17:37:26.986605 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 314/640] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:37:26 2022] DELETE /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments/d758e0ba-b682-4b85-a7f6-a3ce32de01a9 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 17:37:26.992278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-93530363-4395-442f-8d67-2222866198a9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:26.992814 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-93530363-4395-442f-8d67-2222866198a9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:26.998824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93530363-4395-442f-8d67-2222866198a9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:26.999305 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93530363-4395-442f-8d67-2222866198a9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:26.999741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93530363-4395-442f-8d67-2222866198a9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.000425 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93530363-4395-442f-8d67-2222866198a9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:27.000877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93530363-4395-442f-8d67-2222866198a9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:27.001300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93530363-4395-442f-8d67-2222866198a9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.066954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-93530363-4395-442f-8d67-2222866198a9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "POST /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/action" status: 202 len: 0 microversion: 2.1 time: 0.078350 Sep 01 17:37:27.070186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 327/641] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:37:26 2022] POST /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:37:27.075590 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:27.076904 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:27.082744 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:27.083477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:27.083908 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.084589 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:27.085036 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:27.085495 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:27.213799 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:27.221956 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5008ed09-2993-48ad-b72c-9c78e53df5be tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1728 microversion: 2.1 time: 0.150179 Sep 01 17:37:27.222502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 315/642] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:27 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:28.243186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:28.244390 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:28.250976 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:28.251452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:28.251885 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:28.252567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:28.253017 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:28.253469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:28.385140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:28.393488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0cf293af-1376-4c81-988c-dcceab19e23b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1728 microversion: 2.1 time: 0.154619 Sep 01 17:37:28.394050 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 328/643] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:28 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:29.414833 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:29.415939 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:29.422433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:29.422905 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:29.423330 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:29.423999 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:29.424444 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:29.424856 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:29.549471 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:29.558092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ed350151-d034-4f1a-b1fe-9a8a9b4dbcd8 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1728 microversion: 2.1 time: 0.147128 Sep 01 17:37:29.558643 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 316/644] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:29 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:30.578886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:30.579495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:30.586185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:30.586666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:30.587101 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:30.587824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:30.588278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:30.588697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:30.606389 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:30.727686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:30.735829 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fc0ea021-bc8d-4908-b2c3-57c080d7eca1 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1728 microversion: 2.1 time: 0.160777 Sep 01 17:37:30.736392 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 329/645] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:30 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:31.757263 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:31.757892 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:31.764341 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:31.764816 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:31.765244 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:31.765946 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:31.766394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:31.766812 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:31.895233 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:31.903562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-04d778e4-627d-4b86-bc7d-e4fb8eb6e7c3 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1728 microversion: 2.1 time: 0.150203 Sep 01 17:37:31.904119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 317/646] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:31 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:32.924846 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:32.925499 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:32.932091 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:32.932580 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:32.933021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:32.933739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:32.934196 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:32.934620 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:33.065578 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:33.073641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6f3642d8-be98-41f2-a7f9-845cb285c31c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1734 microversion: 2.1 time: 0.152582 Sep 01 17:37:33.074201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 330/647] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:32 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:33.094219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f040ded1-864a-40f2-9177-d2b7fd683f18 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:33.094702 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f040ded1-864a-40f2-9177-d2b7fd683f18 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:33.101002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f040ded1-864a-40f2-9177-d2b7fd683f18 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:33.101514 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f040ded1-864a-40f2-9177-d2b7fd683f18 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:33.101945 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f040ded1-864a-40f2-9177-d2b7fd683f18 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:33.102622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f040ded1-864a-40f2-9177-d2b7fd683f18 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:33.103619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f040ded1-864a-40f2-9177-d2b7fd683f18 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:33.104036 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f040ded1-864a-40f2-9177-d2b7fd683f18 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:33.183816 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f040ded1-864a-40f2-9177-d2b7fd683f18 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093347 Sep 01 17:37:33.184423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 318/648] 10.222.0.102 () {58 vars in 1280 bytes} [Thu Sep 1 17:37:33 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:34.348061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-01d5a79d-6da4-42c3-9f73-d4e28678446c req-986d4bbe-0d25-4f02-832f-5f77f28176dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea8f35b-6c91-4f1c-8671-1b47c2e93e20", "tag": "57a67469-4a06-4c97-a8c0-1b41de05d545"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:34.358106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-01d5a79d-6da4-42c3-9f73-d4e28678446c req-986d4bbe-0d25-4f02-832f-5f77f28176dc service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:34.358588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-01d5a79d-6da4-42c3-9f73-d4e28678446c req-986d4bbe-0d25-4f02-832f-5f77f28176dc service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:34.359076 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-01d5a79d-6da4-42c3-9f73-d4e28678446c req-986d4bbe-0d25-4f02-832f-5f77f28176dc service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:34.370020 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-01d5a79d-6da4-42c3-9f73-d4e28678446c req-986d4bbe-0d25-4f02-832f-5f77f28176dc service nova] Creating event network-changed:57a67469-4a06-4c97-a8c0-1b41de05d545 for instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 on hv-cinder-85221 Sep 01 17:37:34.375017 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-01d5a79d-6da4-42c3-9f73-d4e28678446c req-986d4bbe-0d25-4f02-832f-5f77f28176dc service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113223 Sep 01 17:37:34.375621 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 331/649] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:36.389819 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-d56728d3-4f2d-4a88-8ec4-913ac2702a85 req-6a677b11-f74c-4fe7-9ef8-d83bdc111f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea8f35b-6c91-4f1c-8671-1b47c2e93e20", "tag": "57a67469-4a06-4c97-a8c0-1b41de05d545"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:36.399130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-d56728d3-4f2d-4a88-8ec4-913ac2702a85 req-6a677b11-f74c-4fe7-9ef8-d83bdc111f5c service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:36.399606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-d56728d3-4f2d-4a88-8ec4-913ac2702a85 req-6a677b11-f74c-4fe7-9ef8-d83bdc111f5c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:36.400033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-d56728d3-4f2d-4a88-8ec4-913ac2702a85 req-6a677b11-f74c-4fe7-9ef8-d83bdc111f5c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:36.410879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-d56728d3-4f2d-4a88-8ec4-913ac2702a85 req-6a677b11-f74c-4fe7-9ef8-d83bdc111f5c service nova] Creating event network-changed:57a67469-4a06-4c97-a8c0-1b41de05d545 for instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 on hv-cinder-85221 Sep 01 17:37:36.417481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-d56728d3-4f2d-4a88-8ec4-913ac2702a85 req-6a677b11-f74c-4fe7-9ef8-d83bdc111f5c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031906 Sep 01 17:37:36.418037 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 319/650] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:52.945185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=17 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:52.946009 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=10 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:52.950139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:52.950720 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:52.957843 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:52.958324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:52.958761 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:52.959444 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:52.959898 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:52.960322 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:52.984606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:37:53.058356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f99038f8-db35-417d-98d7-a9f7fcbcaca9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "DELETE /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 204 len: 0 microversion: 2.1 time: 0.114553 Sep 01 17:37:53.059043 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 332/651] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:37:52 2022] DELETE /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:37:53.065908 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=21 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:53.066580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=37 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:37:53.070915 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:53.071611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:53.078712 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:53.079193 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:53.079629 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:53.080333 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:53.080769 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:53.081190 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:53.214611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:53.222280 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d4b508d4-ef4c-49ec-9741-b3431b4b7db6 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1578 microversion: 2.1 time: 0.158203 Sep 01 17:37:53.222840 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 320/652] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:53 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:53.711024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6bcbc945-d5bf-4067-98c1-c902d05e683c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:53.713278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6bcbc945-d5bf-4067-98c1-c902d05e683c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:53.719170 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6bcbc945-d5bf-4067-98c1-c902d05e683c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:53.719644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6bcbc945-d5bf-4067-98c1-c902d05e683c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:53.720073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6bcbc945-d5bf-4067-98c1-c902d05e683c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:53.720748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6bcbc945-d5bf-4067-98c1-c902d05e683c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:53.721195 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6bcbc945-d5bf-4067-98c1-c902d05e683c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:53.721645 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6bcbc945-d5bf-4067-98c1-c902d05e683c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:53.793223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6bcbc945-d5bf-4067-98c1-c902d05e683c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "POST /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/action" status: 202 len: 0 microversion: 2.1 time: 0.086504 Sep 01 17:37:53.793872 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 333/653] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:37:53 2022] POST /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:37:53.801751 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:53.802350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:53.808247 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:53.808722 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:53.809143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:53.809842 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:53.810279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:53.810695 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:53.951894 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:53.963382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-89b8735c-6d5a-4caa-9e9d-5aff65b0ebec tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1755 microversion: 2.1 time: 0.165282 Sep 01 17:37:53.963860 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 321/654] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:53 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:54.246584 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:54.247210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:54.253361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:54.253849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:54.254286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:54.254971 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:54.255425 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:54.255846 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:54.384745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:54.392425 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-4417ab19-f537-447a-a0aa-252b3794214f tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1578 microversion: 2.1 time: 0.150720 Sep 01 17:37:54.392984 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 334/655] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:54 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:54.986213 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:54.986904 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:54.994417 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:54.994900 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:54.995336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:54.996030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:54.996480 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:54.996900 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:55.162731 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:55.171818 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cd966005-1031-464e-9441-102192cff72f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1755 microversion: 2.1 time: 0.189960 Sep 01 17:37:55.172374 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 322/656] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:54 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:55.414002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:55.415094 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:55.421640 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:55.422121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:55.422558 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:55.423242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:55.423693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:55.424110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:55.552214 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:55.559887 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3c445e69-87bc-40df-94fb-c8c225061f66 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1578 microversion: 2.1 time: 0.149840 Sep 01 17:37:55.560475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 335/657] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:55 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:56.193439 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:56.194055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:56.200316 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:56.200798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:56.201364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:56.201958 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:56.202413 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:56.202831 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:56.483290 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:56.491985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-eff76942-2f1f-4737-9652-162cd1867f2c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1755 microversion: 2.1 time: 0.302450 Sep 01 17:37:56.492808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 323/658] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:56 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1755 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:37:56.580573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:56.581190 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:56.588797 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:56.589393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:56.589830 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:56.590518 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:56.590965 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:56.591398 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:56.659377 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:56.667319 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3097ba46-8a40-4279-a94d-c1cb76ae0a28 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1511 microversion: 2.1 time: 0.090659 Sep 01 17:37:56.667896 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 336/659] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:56 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1511 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:56.954427 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-230f3a37-0018-4a04-b2f3-3995661d5fe5 req-f9dbcccb-1cc0-4a76-98f4-93dcbf200226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbe128c-ca7d-41f4-9013-2110694968fa", "name": "network-vif-deleted", "tag": "d8c0604b-0167-41b0-811b-5a0f5ab981b6"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:56.967024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-230f3a37-0018-4a04-b2f3-3995661d5fe5 req-f9dbcccb-1cc0-4a76-98f4-93dcbf200226 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:56.967424 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-230f3a37-0018-4a04-b2f3-3995661d5fe5 req-f9dbcccb-1cc0-4a76-98f4-93dcbf200226 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:56.967844 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-230f3a37-0018-4a04-b2f3-3995661d5fe5 req-f9dbcccb-1cc0-4a76-98f4-93dcbf200226 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:56.980054 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-230f3a37-0018-4a04-b2f3-3995661d5fe5 req-f9dbcccb-1cc0-4a76-98f4-93dcbf200226 service nova] Creating event network-vif-deleted:d8c0604b-0167-41b0-811b-5a0f5ab981b6 for instance bbbe128c-ca7d-41f4-9013-2110694968fa on hv-cinder-85221 Sep 01 17:37:56.985245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-230f3a37-0018-4a04-b2f3-3995661d5fe5 req-f9dbcccb-1cc0-4a76-98f4-93dcbf200226 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034341 Sep 01 17:37:56.986284 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 324/660] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:37:57.513336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:57.513961 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:57.520032 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:57.520697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:57.521293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:57.522316 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:57.522760 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:57.523461 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:57.678295 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:57.688970 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-df427762-70a5-4741-9107-bdbe7678144e tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.180877 Sep 01 17:37:57.690071 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 337/661] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:57 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:57.694448 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:57.695222 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:57.702538 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:57.703178 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:57.703713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:57.704572 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:57.705028 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:57.705491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:57.740007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:57.740492 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:57.740919 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:57.741383 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lazy-loading 'fault' on Instance uuid bbbe128c-ca7d-41f4-9013-2110694968fa {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:37:57.793135 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:57.801360 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-bbfacde0-dc11-49b6-8a59-5209d75bff3c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 200 len: 1233 microversion: 2.1 time: 0.116061 Sep 01 17:37:57.801919 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 325/662] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:57 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 1233 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:58.712074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:58.712736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:58.719621 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:58.720220 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:58.720716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:58.721525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:58.722042 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:58.722528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:58.825526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:58.826255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:58.834481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:58.834983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:58.835414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:58.836119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:58.836805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:58.837412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:58.857597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] HTTP exception thrown: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Request method failure captured: Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa HTTP/1.1 Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOz6SiteVYGfythyB7NWby-1Tuyl3GQHRYmX3eA_o3S5CahmIU2mQKqPgdhLUOiqfhGo674xAZuQx-LlLgrD1rFnP9cGmEyOBqVO4nfDJBocHA3ETEG9XSUv4hwGt7OeoqEw9NzYSpGjFa6hn1Av5nbBwF79ziA9xhccTsDZPXuljoA Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:37:58.859627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_2cc300abf09e4bb3857336df552286e2", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}] Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 8f59383e2f6c4da8b683d718f62d25fb Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:37:58.861409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': 'bbbe128c-ca7d-41f4-9013-2110694968fa'} Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:37:58.862350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:37:58.863857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:37:58.865148 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Returning 404 to user: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:37:58.865148 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3fd2ebe0-8586-40b6-8826-5530c632f278 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 404 len: 111 microversion: 2.1 time: 0.039739 Sep 01 17:37:58.870796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 326/663] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:58 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:37:58.888465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:37:58.896792 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-93f43fd8-852d-4a17-ae28-8fb9a9918c5c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.188734 Sep 01 17:37:58.897372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 338/664] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:58 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:37:58.965396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2101698641", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-580347756", "security_groups": [{"name": "tempest-secgroup-smoke-412480106"}], "block_device_mapping_v2": [{"uuid": "af674d77-3b22-4301-9175-24ad566ee9e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41816984-3dfb-46d4-ba93-ea737106ee4f"}]}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:37:59.082811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] validate_networks() for [('41816984-3dfb-46d4-ba93-ea737106ee4f', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:37:59.720138 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:37:59.720552 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:37:59.721020 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:37:59.721453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:37:59.721976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:37:59.730632 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.731105 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.731533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.732272 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.732717 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.733133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.749940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Getting quotas for project 2cc300abf09e4bb3857336df552286e2. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:37:59.753881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Getting quotas for user 8f59383e2f6c4da8b683d718f62d25fb and project 2cc300abf09e4bb3857336df552286e2. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:37:59.811048 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:37:59.813137 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af674d77-3b22-4301-9175-24ad566ee9e5',volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:37:59.918046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:59.918669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:37:59.925005 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.925518 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.925949 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.926640 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:37:59.927091 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:37:59.927508 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:37:59.940557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e3f2c02d-f70a-477c-a45f-88006479032b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.979460 Sep 01 17:37:59.947747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 327/665] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:37:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:37:59.953770 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5c849d4e-22ea-4c22-9888-42c7568d5697 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:37:59.954495 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5c849d4e-22ea-4c22-9888-42c7568d5697 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:00.012427 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5c849d4e-22ea-4c22-9888-42c7568d5697 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:00.019751 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5c849d4e-22ea-4c22-9888-42c7568d5697 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1097 microversion: 2.1 time: 0.070420 Sep 01 17:38:00.020399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 328/666] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:59 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1097 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:00.090253 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:00.098644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fb7cee5f-ff25-4d39-829a-5ce2b5f7eecb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.184520 Sep 01 17:38:00.099202 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 339/667] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:37:59 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:01.039859 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:01.040431 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:01.047241 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.047725 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.048154 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:01.048832 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.049296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.049720 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:01.114154 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:01.119966 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:01.120571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:01.121824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-94ae5bc8-cc02-4bf1-acd0-6d8d5e210c23 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1195 microversion: 2.1 time: 0.085814 Sep 01 17:38:01.122379 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 329/668] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:01 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1195 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:01.127120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.127605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.128039 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:01.128730 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:01.129184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:01.129646 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:01.269212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:01.277448 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-36da4dda-dc29-4666-99d8-cb2cfa5979d7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.161299 Sep 01 17:38:01.278020 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 340/669] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:01 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:02.142817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:02.143566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:02.150261 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:02.150806 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:02.151241 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:02.151938 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:02.152387 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:02.152859 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:02.299270 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:02.301358 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:02.309851 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:02.310321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:02.310775 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:02.311745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:02.312540 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:02.312993 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:02.370479 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:02.378966 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-64901d77-f979-41ce-9a04-6dbd37b2a76b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1280 microversion: 2.1 time: 0.240304 Sep 01 17:38:02.393010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 330/670] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:02 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:02.482727 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:02.492875 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c50af4ad-ce7b-4ce5-b82e-172db96d4ae4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.197124 Sep 01 17:38:02.493591 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 341/671] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:02 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:02.901644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-05e556b5-a40a-4b32-b46a-34c38430113e req-cd95853f-f8c1-42b0-94a6-b7506bfc4a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac61b88-58ea-45b4-bb8a-9e16713010b2", "tag": "96c5512d-5f40-4852-aa83-f665f3064d76"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:02.911747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-05e556b5-a40a-4b32-b46a-34c38430113e req-cd95853f-f8c1-42b0-94a6-b7506bfc4a88 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:02.912636 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-05e556b5-a40a-4b32-b46a-34c38430113e req-cd95853f-f8c1-42b0-94a6-b7506bfc4a88 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:02.912636 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-05e556b5-a40a-4b32-b46a-34c38430113e req-cd95853f-f8c1-42b0-94a6-b7506bfc4a88 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:02.923906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-05e556b5-a40a-4b32-b46a-34c38430113e req-cd95853f-f8c1-42b0-94a6-b7506bfc4a88 service nova] Creating event network-changed:96c5512d-5f40-4852-aa83-f665f3064d76 for instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 on hv-cinder-85221 Sep 01 17:38:02.928757 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-05e556b5-a40a-4b32-b46a-34c38430113e req-cd95853f-f8c1-42b0-94a6-b7506bfc4a88 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031322 Sep 01 17:38:02.929407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 331/672] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:03.400640 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:03.401245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:03.408028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:03.408512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:03.408963 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.409677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:03.410124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:03.410541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.516219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:03.516945 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:03.523573 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:03.524052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:03.524477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.525164 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:03.525642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:03.526080 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:03.540525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:03.548086 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c9d07305-a216-420a-8088-dfe48a60873b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.152015 Sep 01 17:38:03.548648 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 342/673] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:03 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:03.663834 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:03.672015 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b43bdb5a-f617-4251-b0f5-b494c2ec7965 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.161013 Sep 01 17:38:03.672579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 332/674] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:03 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:04.569460 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:04.570128 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:04.576801 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.577290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.577744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.578436 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.578892 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.579316 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.693402 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:04.694010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:04.701070 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.701583 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.702015 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.702703 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:04.703151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:04.703566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:04.718191 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:04.725940 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-cad7e2c7-e3f9-436c-8cc3-994c5e018c63 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.160336 Sep 01 17:38:04.726591 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 343/675] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:04 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:04.843342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:04.852063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-546cea65-4a4f-4503-9223-0c8a592983eb tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.162458 Sep 01 17:38:04.852735 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 333/676] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:04 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:05.747027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:05.747571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:05.754007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.754487 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.754918 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.755598 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.756047 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.756464 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.873187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:05.873830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:05.880121 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.880589 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.881008 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.881704 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:05.882151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:05.882562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:05.887952 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:05.895649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b02f0427-6cd5-4acd-bbc2-07cee787949d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.152588 Sep 01 17:38:05.896209 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 344/677] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:05 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:06.023554 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:06.031946 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4c13a08a-fbad-4242-9b45-9fcdd12b8dbd tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.162600 Sep 01 17:38:06.032499 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 334/678] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:05 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:06.917121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:06.917755 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:06.924107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:06.924584 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:06.925011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:06.925726 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:06.926171 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:06.926585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.053525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:07.054132 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:07.060211 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:07.061615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:07.062251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:07.062744 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.063671 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:07.064189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:07.064670 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:07.067757 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:07.071278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-eddadc71-4223-4404-8fd0-73c48943c2fb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.157927 Sep 01 17:38:07.081443 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 345/679] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:06 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:07.280036 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:07.288076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-11e48127-6b2d-4c9f-85fb-9a24a4144a27 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.238485 Sep 01 17:38:07.288633 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 335/680] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:07 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:38:08.092617 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:08.093169 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:08.102007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:08.102481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:08.102932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:08.103615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:08.104061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:08.104476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:08.235949 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:08.243568 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d72f54e7-db65-4089-864a-c6c16b53df60 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.155212 Sep 01 17:38:08.244120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 346/681] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:08 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:08.308402 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:08.309003 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:08.316538 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:08.317288 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:08.317727 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:08.318404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:08.318848 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:08.319261 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:08.455437 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:08.464397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-309ea993-7666-4595-b6aa-42536393ff57 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.159789 Sep 01 17:38:08.464960 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 336/682] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:08 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:09.264341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:09.264872 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:09.271364 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.271849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.272284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.273604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.274058 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.274483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.402105 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:09.409772 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f8a76db8-a459-4ed5-95c5-c5ce23d5d7be tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.149323 Sep 01 17:38:09.410335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 347/683] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:09 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:09.485584 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:09.486196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:09.493898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.494377 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.494813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.495494 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:09.495947 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:09.496367 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:09.638235 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:09.646518 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-90774166-49e1-43e2-a02a-bee395d5ecc9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.164868 Sep 01 17:38:09.647071 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 337/684] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:09 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:10.430741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:10.431352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:10.437784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.438265 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.438695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.439384 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.439838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.440269 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.573009 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:10.580689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a494379a-d4d6-485f-8bca-fd038679724a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.154384 Sep 01 17:38:10.581547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 348/685] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:10 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:10.666982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:10.667493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:10.669470 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:10.670135 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=8 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:10.676597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.677067 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.677517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.678191 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:10.678632 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:10.679680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:10.818773 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:10.827420 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4e099ca9-54aa-437d-aa18-27693f44da95 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.164568 Sep 01 17:38:10.827691 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 338/686] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:10 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:11.601924 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:11.602608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:11.609244 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:11.609747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:11.610175 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:11.610858 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:11.611306 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:11.611723 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:11.742167 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:11.749827 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0123ce1b-8889-46b4-94bf-c84b60725d95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.151919 Sep 01 17:38:11.750392 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 349/687] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:11 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:11.847860 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:11.848468 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:11.854883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:11.855297 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:11.855726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:11.856409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:11.856857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:11.857275 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:11.998518 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:12.002468 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:12.008174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f55ab1e5-5e9a-48eb-897f-e3a24239ae9a tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1760 microversion: 2.1 time: 0.164168 Sep 01 17:38:12.008729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 339/688] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:11 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:12.771217 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:12.771748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:12.778538 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:12.779014 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:12.779430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:12.780110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:12.780553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:12.780989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:12.915382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:12.923032 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2263b647-af24-41ec-9b51-0bf7c100a56b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.155732 Sep 01 17:38:12.923572 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 350/689] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:12 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:13.029597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:13.030130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:13.036693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.037176 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.037650 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.038342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.038794 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.039213 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.176828 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:13.185103 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-87d4733c-5d9c-43ff-9f9d-a6cae659f6c4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1763 microversion: 2.1 time: 0.159890 Sep 01 17:38:13.185700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 340/690] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:13 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1763 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:13.943542 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:13.944173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:13.950851 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.951332 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.951763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:13.952448 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:13.952897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:13.953329 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:14.086052 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:14.093690 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-badbf248-5206-42ed-bea8-26c9f9188ee9 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.153957 Sep 01 17:38:14.094259 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 351/691] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:13 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:14.247529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:14.248051 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:14.254178 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:14.254667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:14.255102 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:14.255794 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:14.256250 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:14.256739 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:14.338040 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lazy-loading 'services' on Instance uuid 14064865-1bc2-4b27-993b-cd5e726de947 {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:14.452174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3ca8b5a4-884f-471b-902c-14d29f9dc74f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "DELETE /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/os-volume_attachments/a7bd9581-17b7-4d0e-a725-4ca6c70fda3f" status: 202 len: 0 microversion: 2.1 time: 0.307081 Sep 01 17:38:14.457574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 341/692] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:38:14 2022] DELETE /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/os-volume_attachments/a7bd9581-17b7-4d0e-a725-4ca6c70fda3f => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:38:15.115168 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:15.117046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:15.124061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:15.124577 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:15.125017 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:15.125774 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:15.126229 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:15.126654 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:15.256020 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:15.263582 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-980b8849-0cee-4ddd-a3b9-dd29fbcbfbcb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.152335 Sep 01 17:38:15.264160 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 352/693] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:15 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:15.573924 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-46359b69-9af0-4db8-9823-89737c74653e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:15.581367 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46359b69-9af0-4db8-9823-89737c74653e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:15.581854 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46359b69-9af0-4db8-9823-89737c74653e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:15.582287 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46359b69-9af0-4db8-9823-89737c74653e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:15.605195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-46359b69-9af0-4db8-9823-89737c74653e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Going to try to stop instance {{(pid=121745) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 17:38:15.645095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-46359b69-9af0-4db8-9823-89737c74653e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/action" status: 202 len: 0 microversion: 2.1 time: 0.075133 Sep 01 17:38:15.645710 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 342/694] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:38:15 2022] POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:38:15.654463 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:15.655080 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:15.661097 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:15.661817 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:15.662305 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:15.663027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:15.664312 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:15.664681 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:15.802956 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:15.814540 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-423f3ef6-cdbc-45fe-bc61-d5c75d74a2fc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.163931 Sep 01 17:38:15.815127 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 353/695] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:15 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:15.912497 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-07eef4f7-a145-4152-a39f-956414c0e755 req-01a29243-c73c-405b-96ed-95e7179162d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac61b88-58ea-45b4-bb8a-9e16713010b2", "name": "network-vif-plugged", "status": "completed", "tag": "96c5512d-5f40-4852-aa83-f665f3064d76"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:15.922586 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-07eef4f7-a145-4152-a39f-956414c0e755 req-01a29243-c73c-405b-96ed-95e7179162d2 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:15.923067 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-07eef4f7-a145-4152-a39f-956414c0e755 req-01a29243-c73c-405b-96ed-95e7179162d2 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:15.923499 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-07eef4f7-a145-4152-a39f-956414c0e755 req-01a29243-c73c-405b-96ed-95e7179162d2 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:15.934680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-07eef4f7-a145-4152-a39f-956414c0e755 req-01a29243-c73c-405b-96ed-95e7179162d2 service nova] Creating event network-vif-plugged:96c5512d-5f40-4852-aa83-f665f3064d76 for instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 on hv-cinder-85221 Sep 01 17:38:15.939352 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-07eef4f7-a145-4152-a39f-956414c0e755 req-01a29243-c73c-405b-96ed-95e7179162d2 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030911 Sep 01 17:38:15.939944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 343/696] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:16.283917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:16.284440 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:16.291395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:16.291874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:16.292303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:16.292984 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:16.293456 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:16.293870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:16.428658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:16.439124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-bca67273-847e-47c1-9517-2ed4cf682def tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.159186 Sep 01 17:38:16.439686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 354/697] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:16 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:16.837662 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:16.838422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:16.844422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:16.844891 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:16.845327 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:16.846009 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:16.846454 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:16.846869 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:16.977579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:16.985189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-57b12d5a-2d9b-48bd-aaed-b492ad6e11e0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.152942 Sep 01 17:38:16.985780 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 344/698] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:16 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:17.459147 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:17.459803 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:17.466498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.466983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.467420 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:17.468107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:17.468570 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:17.468992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:17.598983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:17.607030 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-495eefad-8b63-4163-8264-10e567b9c9ba tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1268 microversion: 2.1 time: 0.152077 Sep 01 17:38:17.607597 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 355/699] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:17 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:18.006845 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:18.007438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:18.013831 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.014313 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.014742 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.015465 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.015877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.016298 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.156811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:18.164697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-82f260e4-8d8b-4010-b2af-7025b211b6dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.161915 Sep 01 17:38:18.165263 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 345/700] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:18 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:18.627970 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:18.628618 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:18.635755 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.636234 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.636674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.637402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.637866 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.638304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.774015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:18.781925 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c60c39f6-9339-408d-a006-de6e1592c3e8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1454 microversion: 2.1 time: 0.157821 Sep 01 17:38:18.782496 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 356/701] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:18 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:18.802068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:18.802679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:18.809083 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.809597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.810038 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.810727 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:18.811194 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:18.811600 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:18.944606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:18.952352 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-51121e55-95ca-49d7-aba1-3b862802ffeb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1454 microversion: 2.1 time: 0.154103 Sep 01 17:38:18.952910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 346/702] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:18 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:19.185890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:19.186533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:19.192417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:19.192899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:19.193351 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:19.194077 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:19.194531 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:19.194956 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:19.322361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:19.330342 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ad8b01ae-ab4c-437e-82d7-214870626cc3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.148385 Sep 01 17:38:19.331247 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 357/703] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:19 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:20.352496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:20.353102 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:20.359498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:20.359990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:20.360647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:20.361096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:20.361573 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:20.362347 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:20.592693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:20.600904 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b4f7892b-aab7-412c-8bec-6a42f0d683d0 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.252310 Sep 01 17:38:20.601498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 347/704] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:20 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:20.833581 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-e33914e5-7aac-4acd-a46d-d5a07ff93a0d req-07ea2bca-48a1-4255-9742-790c9cc258a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac61b88-58ea-45b4-bb8a-9e16713010b2", "tag": "96c5512d-5f40-4852-aa83-f665f3064d76"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:20.844198 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-e33914e5-7aac-4acd-a46d-d5a07ff93a0d req-07ea2bca-48a1-4255-9742-790c9cc258a6 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:20.844666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-e33914e5-7aac-4acd-a46d-d5a07ff93a0d req-07ea2bca-48a1-4255-9742-790c9cc258a6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:20.845087 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-e33914e5-7aac-4acd-a46d-d5a07ff93a0d req-07ea2bca-48a1-4255-9742-790c9cc258a6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:20.857256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-e33914e5-7aac-4acd-a46d-d5a07ff93a0d req-07ea2bca-48a1-4255-9742-790c9cc258a6 service nova] Creating event network-changed:96c5512d-5f40-4852-aa83-f665f3064d76 for instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 on hv-cinder-85221 Sep 01 17:38:20.862217 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-e33914e5-7aac-4acd-a46d-d5a07ff93a0d req-07ea2bca-48a1-4255-9742-790c9cc258a6 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032655 Sep 01 17:38:20.862798 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 358/705] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:38:21.621296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:21.621951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:21.628635 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:21.629120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:21.629588 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:21.630295 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:21.630751 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:21.631255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:21.765866 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:21.774689 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-dbefb178-e48a-4416-8507-641db795f93f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.157165 Sep 01 17:38:21.775272 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 348/706] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:21 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:22.796880 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:22.797519 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:22.803596 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:22.804077 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:22.804510 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:22.805186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:22.805682 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:22.806100 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:22.937564 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:22.945882 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-cef33e45-51df-4629-8ba5-80bc360087b8 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.153785 Sep 01 17:38:22.946575 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 359/707] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:22 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:23.967334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:23.967975 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:23.970408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:23.976697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:23.977174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:23.977631 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:23.978307 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:23.978749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:23.979160 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:24.111391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:24.119673 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b983d0c3-87a3-4a17-aade-6b65ae8d9d21 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.156299 Sep 01 17:38:24.120233 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 349/708] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:23 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:25.140679 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:25.141241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:25.143784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:25.149689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.150173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.150609 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.151296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.151750 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.152174 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.276278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:25.283952 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b732f95b-487a-46e7-a189-187d2a77fa2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.147196 Sep 01 17:38:25.284512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 360/709] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:25 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:25.428063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1b6c641e-2344-4d3c-aeeb-e65ff3ecc214 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:25.428557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1b6c641e-2344-4d3c-aeeb-e65ff3ecc214 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:25.435408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b6c641e-2344-4d3c-aeeb-e65ff3ecc214 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.435885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b6c641e-2344-4d3c-aeeb-e65ff3ecc214 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.436315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b6c641e-2344-4d3c-aeeb-e65ff3ecc214 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.436990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b6c641e-2344-4d3c-aeeb-e65ff3ecc214 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.437478 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b6c641e-2344-4d3c-aeeb-e65ff3ecc214 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.437896 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b6c641e-2344-4d3c-aeeb-e65ff3ecc214 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.466485 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1b6c641e-2344-4d3c-aeeb-e65ff3ecc214 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments/d119c4c0-296a-443f-ac09-26e1001f31c0" status: 200 len: 194 microversion: 2.20 time: 0.042557 Sep 01 17:38:25.467043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 350/710] 10.222.0.102 () {60 vars in 1459 bytes} [Thu Sep 1 17:38:25 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments/d119c4c0-296a-443f-ac09-26e1001f31c0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:38:25.533823 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:25.534307 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:25.540643 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.541130 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.541608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.542303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.542756 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.543176 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.665722 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lazy-loading 'services' on Instance uuid b61004bf-b919-4848-8efa-ba83a2a8e633 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:25.777059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b3b76194-750f-40b6-b5ab-9ed97a9c5a57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "DELETE /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments/d119c4c0-296a-443f-ac09-26e1001f31c0" status: 202 len: 0 microversion: 2.20 time: 0.246931 Sep 01 17:38:25.777696 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 361/711] 10.222.0.102 () {60 vars in 1462 bytes} [Thu Sep 1 17:38:25 2022] DELETE /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments/d119c4c0-296a-443f-ac09-26e1001f31c0 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:38:25.786073 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ee335125-d332-497d-8ffe-dc065c5120df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:25.788879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ee335125-d332-497d-8ffe-dc065c5120df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:25.795042 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee335125-d332-497d-8ffe-dc065c5120df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.795859 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee335125-d332-497d-8ffe-dc065c5120df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.796430 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee335125-d332-497d-8ffe-dc065c5120df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.797320 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee335125-d332-497d-8ffe-dc065c5120df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:25.797957 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee335125-d332-497d-8ffe-dc065c5120df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:25.798528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee335125-d332-497d-8ffe-dc065c5120df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:25.832081 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ee335125-d332-497d-8ffe-dc065c5120df tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049926 Sep 01 17:38:25.832642 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 351/712] 10.222.0.102 () {60 vars in 1348 bytes} [Thu Sep 1 17:38:25 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:38:26.305933 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:26.306623 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:26.313131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:26.313642 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:26.314176 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:26.314920 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:26.315379 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:26.315797 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:26.334647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:26.446361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:26.453961 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2b5d5a9a-a17d-4b6b-a658-c39a581744a4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.152717 Sep 01 17:38:26.454524 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 362/713] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:26 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:26.843932 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8cacdb0a-5c6b-4ed2-b249-98ebb96b45ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:26.846063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8cacdb0a-5c6b-4ed2-b249-98ebb96b45ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:26.852397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cacdb0a-5c6b-4ed2-b249-98ebb96b45ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:26.852876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cacdb0a-5c6b-4ed2-b249-98ebb96b45ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:26.853447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cacdb0a-5c6b-4ed2-b249-98ebb96b45ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:26.854142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cacdb0a-5c6b-4ed2-b249-98ebb96b45ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:26.854591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cacdb0a-5c6b-4ed2-b249-98ebb96b45ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:26.855009 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cacdb0a-5c6b-4ed2-b249-98ebb96b45ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:26.886003 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8cacdb0a-5c6b-4ed2-b249-98ebb96b45ff tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046008 Sep 01 17:38:26.886570 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 352/714] 10.222.0.102 () {60 vars in 1348 bytes} [Thu Sep 1 17:38:26 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:38:27.475149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:27.476299 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:27.482691 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:27.483167 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:27.483591 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:27.484260 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:27.484702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:27.485112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:27.609875 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:27.617441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-96f7487d-111d-4331-9c22-383a16c66d98 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.146145 Sep 01 17:38:27.618008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 363/715] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:27 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:27.898966 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-02984a8a-b7c6-418d-b11b-8669bff40177 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:27.901097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-02984a8a-b7c6-418d-b11b-8669bff40177 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:27.907646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-02984a8a-b7c6-418d-b11b-8669bff40177 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:27.908115 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-02984a8a-b7c6-418d-b11b-8669bff40177 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:27.908536 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-02984a8a-b7c6-418d-b11b-8669bff40177 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:27.909207 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-02984a8a-b7c6-418d-b11b-8669bff40177 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:27.909704 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-02984a8a-b7c6-418d-b11b-8669bff40177 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:27.910113 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-02984a8a-b7c6-418d-b11b-8669bff40177 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:27.937707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-02984a8a-b7c6-418d-b11b-8669bff40177 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043287 Sep 01 17:38:27.938237 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 353/716] 10.222.0.102 () {60 vars in 1348 bytes} [Thu Sep 1 17:38:27 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:27.998146 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:27.998631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:28.004417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.004890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.005330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.006008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.006450 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.007361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.032092 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:38:28.104386 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b69ba665-eb8a-4169-b3df-e73c14d3392f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "DELETE /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 204 len: 0 microversion: 2.20 time: 0.109728 Sep 01 17:38:28.105394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 364/717] 10.222.0.102 () {60 vars in 1285 bytes} [Thu Sep 1 17:38:27 2022] DELETE /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 17:38:28.114318 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:28.114956 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:28.121217 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.121740 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.122179 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.122847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.123300 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.123718 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.249798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:28.258315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:28.259727 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:28.260861 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1622ebab-02cf-460a-bbb9-1321ab362d9b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.151126 Sep 01 17:38:28.261423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 354/718] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:28 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:28.638916 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:28.639634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:28.645951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.646424 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.646849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.647521 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:28.647964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:28.648375 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:28.777342 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:28.785026 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c08c7f8b-32f0-43de-bb27-d795d49b8351 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.150344 Sep 01 17:38:28.785630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 365/719] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:28 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:29.283478 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:29.284081 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:29.291208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:29.291693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:29.292127 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:29.292808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:29.293258 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:29.293705 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:29.311356 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:29.425185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:29.433201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:29.434659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:29.435810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3caa92cb-01df-40c5-a7c4-3f5a50a6e570 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.156278 Sep 01 17:38:29.436366 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 355/720] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:29 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:29.806891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:29.807526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:29.813977 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:29.814516 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:29.814946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:29.815635 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:29.816097 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:29.816512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:29.954054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:29.961945 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a00266d0-14f6-4e09-a1d9-7ebc369b4960 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.159415 Sep 01 17:38:29.962509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 366/721] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:29 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:30.459137 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:30.459739 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:30.466633 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.467111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.467543 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.468219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.468668 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.469088 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.594784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:30.603486 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:30.604917 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:30.606096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-81d75d92-409c-4860-8be9-599c7478ea94 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1724 microversion: 2.20 time: 0.151119 Sep 01 17:38:30.606657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 356/722] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:30 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:30.982895 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:30.983497 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:30.989733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.990208 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.990639 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:30.991321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:30.991765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:30.992199 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.119431 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:31.127190 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-41cbd115-c4bd-47e7-ab73-a59aba5e582b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1680 microversion: 2.1 time: 0.148175 Sep 01 17:38:31.127760 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 367/723] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:30 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:31.498763 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-c8109db8-1dd2-4e04-838a-6b35a7b5865d req-48465734-a69b-4948-ab0a-ea7958926c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61004bf-b919-4848-8efa-ba83a2a8e633", "name": "network-vif-deleted", "tag": "57a21496-3b93-45c7-9205-d2fd2b7131e5"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:31.509761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c8109db8-1dd2-4e04-838a-6b35a7b5865d req-48465734-a69b-4948-ab0a-ea7958926c14 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.510412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c8109db8-1dd2-4e04-838a-6b35a7b5865d req-48465734-a69b-4948-ab0a-ea7958926c14 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.512995 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c8109db8-1dd2-4e04-838a-6b35a7b5865d req-48465734-a69b-4948-ab0a-ea7958926c14 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.523496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-c8109db8-1dd2-4e04-838a-6b35a7b5865d req-48465734-a69b-4948-ab0a-ea7958926c14 service nova] Creating event network-vif-deleted:57a21496-3b93-45c7-9205-d2fd2b7131e5 for instance b61004bf-b919-4848-8efa-ba83a2a8e633 on hv-cinder-85221 Sep 01 17:38:31.528805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-c8109db8-1dd2-4e04-838a-6b35a7b5865d req-48465734-a69b-4948-ab0a-ea7958926c14 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033765 Sep 01 17:38:31.529417 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 357/724] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:31.632555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:31.633258 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:31.639612 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.640167 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.640669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.641462 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:31.641976 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:31.642805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:31.744902 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:31.761765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:31.764392 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:31.765705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f3756dc3-fa33-41b1-b988-9e18924a68dd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 200 len: 1369 microversion: 2.20 time: 0.141200 Sep 01 17:38:31.777330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 368/725] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:31 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 1369 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:32.149269 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:32.149979 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:32.156417 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:32.156892 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:32.157333 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:32.158030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:32.158477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:32.158890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:32.297038 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:32.308057 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-dec95aa0-33cd-43b7-aa92-f4dcb73444ab tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1657 microversion: 2.1 time: 0.163227 Sep 01 17:38:32.308791 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 358/726] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:32 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1657 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:32.331504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-dce3088c-296b-4dc7-939b-98b23cd1192c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:32.347478 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dce3088c-296b-4dc7-939b-98b23cd1192c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:32.347970 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dce3088c-296b-4dc7-939b-98b23cd1192c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:32.348402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dce3088c-296b-4dc7-939b-98b23cd1192c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:32.377997 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-dce3088c-296b-4dc7-939b-98b23cd1192c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Going to try to start instance {{(pid=121744) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 17:38:32.423232 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-dce3088c-296b-4dc7-939b-98b23cd1192c tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/action" status: 202 len: 0 microversion: 2.1 time: 0.095763 Sep 01 17:38:32.424170 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 369/727] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:38:32 2022] POST /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:38:32.432078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:32.432686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:32.440210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:32.440876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:32.442055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:32.442814 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:32.443209 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:32.443628 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:32.584909 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:32.593994 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b5ce6699-c223-4448-a6fd-2432bdd83427 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1666 microversion: 2.1 time: 0.165741 Sep 01 17:38:32.594558 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 359/728] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:32 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:32.793020 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:32.793680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:32.799814 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:32.800302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:32.800737 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:32.801453 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:32.801909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:32.802330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:32.816574 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] HTTP exception thrown: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Request method failure captured: Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 HTTP/1.1 Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxma2FgyTsC6cDAwx1Qenr9c2MeYVTECG0FZEKOY2to7JExjBEtoKRvgnpLWxHxiFNn02km7iPeToINKKsoESJwZy3KvZEoKRIkfF3oa2dtKYRAGDkhBW-T5smj5JIwu7MeAshPgvJ7sYQsky_MguEXvxxoJNBppmU7DsA7rsgO4Iw Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:38:32.818256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_97796d8be4794e89a89965af17bb3fa9", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}] Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 26bf17f1fb8948008fed82f4ba33bf66 Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:38:32.820290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'b61004bf-b919-4848-8efa-ba83a2a8e633'} Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:38:32.821051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:38:32.822325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:38:32.823509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Returning 404 to user: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:38:32.823509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-921dac1d-9ffb-4722-affc-4d7067d91780 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 404 len: 111 microversion: 2.20 time: 0.031079 Sep 01 17:38:32.823509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 370/729] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:32 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 17:38:32.829101 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-461f47a8-c888-420a-aa24-8b2810644b6f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '.version_select at 0x7fb8565b3b80>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:32.849601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-461f47a8-c888-420a-aa24-8b2810644b6f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553625139" status: 204 len: 0 microversion: 2.20 time: 0.024200 Sep 01 17:38:32.850169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 360/730] 10.222.0.102 () {60 vars in 1264 bytes} [Thu Sep 1 17:38:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553625139 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 17:38:33.498417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3e1911e0-6d22-45bb-b259-f18560be03fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'create', calling method: .version_select at 0x7fb85658a670>, body: {"keypair": {"name": "tempest-keypair-1015779580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwjgkfokjZFsLSlo7yb/VovCXcvbCP2F7vWLFHDfUDlI7Z4Gjr7YWXtbGJqso5vACrRuUikTDb+5oUkaF9bV+SewrdsIYTHFEonQnIwZ8EgluQDvNdMmX987rg/0YhkKQ=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:33.514421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-3e1911e0-6d22-45bb-b259-f18560be03fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Getting quotas for project 97796d8be4794e89a89965af17bb3fa9. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:33.518223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-3e1911e0-6d22-45bb-b259-f18560be03fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Getting quotas for user 26bf17f1fb8948008fed82f4ba33bf66 and project 97796d8be4794e89a89965af17bb3fa9. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:33.544703 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3e1911e0-6d22-45bb-b259-f18560be03fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050146 Sep 01 17:38:33.545465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 371/731] 10.222.0.102 () {62 vars in 1205 bytes} [Thu Sep 1 17:38:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 17:38:33.615796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:33.616563 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:33.623438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.623929 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.624364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.625065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:33.625550 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:33.625976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:33.798075 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:33.805811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3395698b-77a0-4a55-840c-3ab19563cf2a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1666 microversion: 2.1 time: 0.194447 Sep 01 17:38:33.806382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 361/732] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:33 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1666 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:34.827989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:34.829356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:34.840008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.840830 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.841705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:34.842727 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:34.843553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:34.844388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.049109 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:35.057358 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5ad6b858-3861-4599-8379-e35104905c0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1670 microversion: 2.1 time: 0.234345 Sep 01 17:38:35.057914 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 372/733] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:34 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1670 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:35.072034 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1305642765", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c1f0e47-9c23-4408-9f07-ba59e0499662"}], "security_groups": [{"name": "tempest-securitygroup--1134515141"}], "key_name": "tempest-keypair-1015779580", "user_data": "}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:35.173952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] validate_networks() for [('0c1f0e47-9c23-4408-9f07-ba59e0499662', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:38:35.529512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:38:35.529874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:38:35.530339 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:38:35.530742 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:38:35.531147 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:38:35.540305 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.540770 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.541223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.541974 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:35.542423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:35.542842 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:35.559809 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Getting quotas for project 97796d8be4794e89a89965af17bb3fa9. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:38:35.563753 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Getting quotas for user 26bf17f1fb8948008fed82f4ba33bf66 and project 97796d8be4794e89a89965af17bb3fa9. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:38:35.574667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:38:35.576913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:38:35.624029 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-dad680aa-bd1f-4144-a15f-bdc11af6ea38 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.556767 Sep 01 17:38:35.624668 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 362/734] 10.222.0.102 () {62 vars in 1193 bytes} [Thu Sep 1 17:38:35 2022] POST /compute/v2.1/servers => generated 404 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 01 17:38:35.636493 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b8a16e70-1a98-47c0-b3e9-cbcf40b587bb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:35.637242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b8a16e70-1a98-47c0-b3e9-cbcf40b587bb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:35.691629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b8a16e70-1a98-47c0-b3e9-cbcf40b587bb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:35.698982 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b8a16e70-1a98-47c0-b3e9-cbcf40b587bb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:35.700421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b8a16e70-1a98-47c0-b3e9-cbcf40b587bb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:35.701562 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b8a16e70-1a98-47c0-b3e9-cbcf40b587bb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1286 microversion: 2.20 time: 0.069858 Sep 01 17:38:35.702108 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 373/735] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:35 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:36.724898 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:36.725469 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:36.732050 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:36.732526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:36.732953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:36.733663 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:36.734113 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:36.734528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:36.796926 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:36.805513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:36.806939 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:36.808028 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-36189f0b-4f23-4b33-b13c-23b97329b2e8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1338 microversion: 2.20 time: 0.087580 Sep 01 17:38:36.808570 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 363/736] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:36 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:37.831739 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:37.832441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:37.840330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:37.841027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:37.841561 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:37.842346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:37.842928 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:37.843555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:37.990383 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:37.999636 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:38.005357 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:38.006498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-765b4b53-8c53-4f89-ae43-32407bf9126c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.179308 Sep 01 17:38:38.008016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 374/737] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:37 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:38.504983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-7e711036-87ca-4b8a-b5c1-0a150bd97ea6 req-fbda4088-9c92-45a1-8c60-7b40903cc3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33c4bba1-dbe2-4433-837f-4da4534901f8", "tag": "568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:38.515167 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-7e711036-87ca-4b8a-b5c1-0a150bd97ea6 req-fbda4088-9c92-45a1-8c60-7b40903cc3c1 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:38.515641 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-7e711036-87ca-4b8a-b5c1-0a150bd97ea6 req-fbda4088-9c92-45a1-8c60-7b40903cc3c1 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:38.516065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-7e711036-87ca-4b8a-b5c1-0a150bd97ea6 req-fbda4088-9c92-45a1-8c60-7b40903cc3c1 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:38.529237 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-7e711036-87ca-4b8a-b5c1-0a150bd97ea6 req-fbda4088-9c92-45a1-8c60-7b40903cc3c1 service nova] Creating event network-changed:568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e for instance 33c4bba1-dbe2-4433-837f-4da4534901f8 on hv-cinder-85221 Sep 01 17:38:38.535736 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-7e711036-87ca-4b8a-b5c1-0a150bd97ea6 req-fbda4088-9c92-45a1-8c60-7b40903cc3c1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034132 Sep 01 17:38:38.536323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 364/738] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:38:39.029591 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:39.030883 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:39.038225 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:39.039213 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:39.039646 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:39.040347 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:39.040797 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:39.041214 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:39.169575 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:39.177696 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:39.179763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:39.180900 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-56b2c209-3927-43d8-b714-6ebc6524ea6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.155208 Sep 01 17:38:39.181693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 375/739] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:39 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:40.204148 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:40.205074 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:40.212230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:40.212709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:40.213142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:40.213861 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:40.214316 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:40.214737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:40.341324 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:40.349378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:40.351421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:40.352525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9ee9ce02-2a02-4a1c-9c37-1e79f246bd6b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.152765 Sep 01 17:38:40.353079 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 365/740] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:40 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:41.374705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:41.375320 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:41.381850 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.382329 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.382763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.383444 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:41.383895 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:41.384315 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:41.509171 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:41.517198 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:41.518669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:41.519765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-893be05e-b3fa-426c-9165-f042f8b0c873 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.149009 Sep 01 17:38:41.520323 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 376/741] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:41 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:42.541751 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:42.542358 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:42.548604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:42.549075 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:42.549533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:42.550210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:42.550652 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:42.551061 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:42.739071 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:42.747109 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:42.748526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:42.749648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a6523570-77cb-4b54-89a9-2d47f646f4e5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.212330 Sep 01 17:38:42.750196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 366/742] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:42 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:43.771816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:43.773066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:43.779043 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:43.779518 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:43.779944 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:43.780628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:43.781078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:43.781534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:43.919336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:43.927512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:43.929938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:43.931300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-237afa24-39cd-458c-8a4a-45fea7acc914 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.163475 Sep 01 17:38:43.931906 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 377/743] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:43 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:44.953923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:44.954781 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:44.961676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.962161 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.962591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:44.963285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:44.963771 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:44.964193 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:45.096625 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:45.105176 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:45.106625 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:45.107747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6a08c24a-6806-4661-b6de-61649a01465e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.157707 Sep 01 17:38:45.108292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 367/744] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:44 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:46.130963 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:46.132186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:46.134848 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:46.140858 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:46.141370 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:46.141821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:46.142662 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:46.143151 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:46.143563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:46.188437 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-a6c8ffc6-0412-4e67-b15c-5b4e4f5c1767 req-016650e1-ed26-46a5-a913-f565495b26e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c4bba1-dbe2-4433-837f-4da4534901f8", "name": "network-vif-plugged", "status": "completed", "tag": "568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:46.195535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:46.196691 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=6 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:46.202201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a6c8ffc6-0412-4e67-b15c-5b4e4f5c1767 req-016650e1-ed26-46a5-a913-f565495b26e7 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:46.202741 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a6c8ffc6-0412-4e67-b15c-5b4e4f5c1767 req-016650e1-ed26-46a5-a913-f565495b26e7 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:46.203165 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a6c8ffc6-0412-4e67-b15c-5b4e4f5c1767 req-016650e1-ed26-46a5-a913-f565495b26e7 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:46.214973 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-a6c8ffc6-0412-4e67-b15c-5b4e4f5c1767 req-016650e1-ed26-46a5-a913-f565495b26e7 service nova] Creating event network-vif-plugged:568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e for instance 33c4bba1-dbe2-4433-837f-4da4534901f8 on hv-cinder-85221 Sep 01 17:38:46.221815 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-a6c8ffc6-0412-4e67-b15c-5b4e4f5c1767 req-016650e1-ed26-46a5-a913-f565495b26e7 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036915 Sep 01 17:38:46.222739 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 368/745] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:46.284993 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:46.304274 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:46.305763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:46.306886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-59667298-d334-4802-a3bf-1fcb12c55ea4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.179889 Sep 01 17:38:46.307451 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 378/746] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:46 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:47.331401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:47.332089 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:47.338276 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:47.338743 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:47.339167 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:47.339835 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:47.340275 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:47.340684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:47.470676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:47.479143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:47.480558 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:47.481667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-73cc296d-8c06-4277-ba44-279a243792b6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.155233 Sep 01 17:38:47.482214 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 369/747] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:47 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:48.504001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:48.504602 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:48.511634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:48.512106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:48.512529 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:48.513203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:48.513668 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:48.514082 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:48.517989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:48.644524 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:48.652477 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:48.653929 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:48.655011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c53d7365-ac34-4d87-87a8-ad05dff3186e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1412 microversion: 2.20 time: 0.155009 Sep 01 17:38:48.655560 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 379/748] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:48 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:49.681637 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:49.682229 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:49.689233 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.689748 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.690173 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.690849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.691289 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.691700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.818202 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:49.826226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:49.827658 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:49.828782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-79c3a19e-9b07-48a4-af39-3803fe330ccd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1604 microversion: 2.20 time: 0.151082 Sep 01 17:38:49.829625 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 370/749] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:38:49 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:38:49.851126 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-92dd01bf-7f27-44b6-b4ba-35b34fead83c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:49.851675 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-92dd01bf-7f27-44b6-b4ba-35b34fead83c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:49.858038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92dd01bf-7f27-44b6-b4ba-35b34fead83c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.858513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92dd01bf-7f27-44b6-b4ba-35b34fead83c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.858940 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92dd01bf-7f27-44b6-b4ba-35b34fead83c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.859615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92dd01bf-7f27-44b6-b4ba-35b34fead83c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:49.860060 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92dd01bf-7f27-44b6-b4ba-35b34fead83c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:49.860500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92dd01bf-7f27-44b6-b4ba-35b34fead83c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:49.935886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-92dd01bf-7f27-44b6-b4ba-35b34fead83c tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089014 Sep 01 17:38:49.936466 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 380/750] 10.222.0.102 () {60 vars in 1321 bytes} [Thu Sep 1 17:38:49 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:38:50.907876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-e4bd4229-7793-4758-a21a-924a946b8197 req-e1490d2f-12a2-45a6-895d-1856aaa61298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33c4bba1-dbe2-4433-837f-4da4534901f8", "tag": "568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:50.917950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-e4bd4229-7793-4758-a21a-924a946b8197 req-e1490d2f-12a2-45a6-895d-1856aaa61298 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:50.918429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-e4bd4229-7793-4758-a21a-924a946b8197 req-e1490d2f-12a2-45a6-895d-1856aaa61298 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:50.918863 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-e4bd4229-7793-4758-a21a-924a946b8197 req-e1490d2f-12a2-45a6-895d-1856aaa61298 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:50.929808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-e4bd4229-7793-4758-a21a-924a946b8197 req-e1490d2f-12a2-45a6-895d-1856aaa61298 service nova] Creating event network-changed:568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e for instance 33c4bba1-dbe2-4433-837f-4da4534901f8 on hv-cinder-85221 Sep 01 17:38:50.934760 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-e4bd4229-7793-4758-a21a-924a946b8197 req-e1490d2f-12a2-45a6-895d-1856aaa61298 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083519 Sep 01 17:38:50.935344 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 371/751] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:51.362345 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:51.363607 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:51.370533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.370533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.370973 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.371900 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.372354 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.372782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.461086 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lazy-loading 'services' on Instance uuid eea8f35b-6c91-4f1c-8671-1b47c2e93e20 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:51.540147 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-296edb25-b5e6-41c6-9c63-f33dbc4a55b9 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "DELETE /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments/d758e0ba-b682-4b85-a7f6-a3ce32de01a9" status: 202 len: 0 microversion: 2.1 time: 0.182240 Sep 01 17:38:51.541155 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 381/752] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:38:51 2022] DELETE /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments/d758e0ba-b682-4b85-a7f6-a3ce32de01a9 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:38:51.549766 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f070c417-6628-43b1-aaec-c7684df9d404 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:51.552118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f070c417-6628-43b1-aaec-c7684df9d404 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:51.559544 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f070c417-6628-43b1-aaec-c7684df9d404 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.560220 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f070c417-6628-43b1-aaec-c7684df9d404 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.560867 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f070c417-6628-43b1-aaec-c7684df9d404 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.561762 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f070c417-6628-43b1-aaec-c7684df9d404 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:51.563018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f070c417-6628-43b1-aaec-c7684df9d404 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:51.563821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f070c417-6628-43b1-aaec-c7684df9d404 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:51.607690 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f070c417-6628-43b1-aaec-c7684df9d404 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062188 Sep 01 17:38:51.608296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 372/753] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:38:51 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:38:52.621782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b49b0a85-baa5-4727-ad41-5850a0eeca8c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:52.624025 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b49b0a85-baa5-4727-ad41-5850a0eeca8c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:52.630179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b49b0a85-baa5-4727-ad41-5850a0eeca8c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.630653 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b49b0a85-baa5-4727-ad41-5850a0eeca8c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.631107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b49b0a85-baa5-4727-ad41-5850a0eeca8c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.631780 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b49b0a85-baa5-4727-ad41-5850a0eeca8c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:52.632226 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b49b0a85-baa5-4727-ad41-5850a0eeca8c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:52.632638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b49b0a85-baa5-4727-ad41-5850a0eeca8c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:52.660530 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b49b0a85-baa5-4727-ad41-5850a0eeca8c tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Sep 01 17:38:52.661060 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 382/754] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:38:52 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:53.673324 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9b050ed8-c9d6-4bc0-89b8-bf6b6121c5ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:53.675423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9b050ed8-c9d6-4bc0-89b8-bf6b6121c5ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:53.682394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9b050ed8-c9d6-4bc0-89b8-bf6b6121c5ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.682876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9b050ed8-c9d6-4bc0-89b8-bf6b6121c5ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.683310 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9b050ed8-c9d6-4bc0-89b8-bf6b6121c5ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.683991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9b050ed8-c9d6-4bc0-89b8-bf6b6121c5ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.684443 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9b050ed8-c9d6-4bc0-89b8-bf6b6121c5ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.684862 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9b050ed8-c9d6-4bc0-89b8-bf6b6121c5ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.713866 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9b050ed8-c9d6-4bc0-89b8-bf6b6121c5ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044612 Sep 01 17:38:53.714414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 373/755] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:38:53 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:38:53.793490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:53.794011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:53.800376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.800861 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.801350 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.802039 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.802494 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.803415 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.830623 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:38:53.906038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-36daf0af-b94b-4819-a22b-b426ac2eb6ba tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "DELETE /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 204 len: 0 microversion: 2.1 time: 0.115951 Sep 01 17:38:53.906675 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 383/756] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:38:53 2022] DELETE /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:38:53.914616 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:53.915215 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:53.921055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.921564 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.921990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:53.922659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:53.923100 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:53.923570 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:54.055681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:54.063348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-188feac4-1991-4988-8ba5-fd875cc4d616 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1694 microversion: 2.1 time: 0.152607 Sep 01 17:38:54.063907 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 374/757] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:53 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:55.085828 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:55.086474 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:55.092974 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:55.093489 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:55.093928 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:55.094615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:55.095069 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:55.095492 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:55.225379 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:55.233208 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9f0dc589-d495-4ee0-a77b-7c07c71a2928 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1694 microversion: 2.1 time: 0.152370 Sep 01 17:38:55.233799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 384/758] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:55 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:56.253652 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:56.254172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:56.256816 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:56.262922 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.263405 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.263836 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:56.264520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:56.264970 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:56.265458 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:56.398421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:56.406110 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9bdd3d30-90ac-47ac-846e-16af05e8d1ab tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1694 microversion: 2.1 time: 0.156445 Sep 01 17:38:56.406670 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 375/759] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:56 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:57.426615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:57.427716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:57.430275 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:57.435955 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.436437 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.436872 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.437593 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:57.438053 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:57.438474 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:57.563881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:57.572187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3db73a39-d954-472f-a1e9-6fb5461ee99b tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1694 microversion: 2.1 time: 0.149434 Sep 01 17:38:57.572751 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 385/760] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:57 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1694 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:58.593655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:58.594273 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:58.600619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:58.601096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:58.601554 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:58.602245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:58.602693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:58.603108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:58.621499 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=100 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:38:58.855574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:58.863250 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1e575e97-5f15-4a70-bcda-1f59a09a80d2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1694 microversion: 2.1 time: 0.273938 Sep 01 17:38:58.863820 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 376/761] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:58 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1694 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:38:59.310488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-a14bc71c-ee8f-4a31-95c7-11b9813de471 req-07f8bf44-cbc2-4578-b3d0-cc348a17cc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea8f35b-6c91-4f1c-8671-1b47c2e93e20", "name": "network-vif-deleted", "tag": "57a67469-4a06-4c97-a8c0-1b41de05d545"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:38:59.324055 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-a14bc71c-ee8f-4a31-95c7-11b9813de471 req-07f8bf44-cbc2-4578-b3d0-cc348a17cc3e service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:59.324557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-a14bc71c-ee8f-4a31-95c7-11b9813de471 req-07f8bf44-cbc2-4578-b3d0-cc348a17cc3e service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:59.324979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-a14bc71c-ee8f-4a31-95c7-11b9813de471 req-07f8bf44-cbc2-4578-b3d0-cc348a17cc3e service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:59.342105 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-a14bc71c-ee8f-4a31-95c7-11b9813de471 req-07f8bf44-cbc2-4578-b3d0-cc348a17cc3e service nova] Creating event network-vif-deleted:57a67469-4a06-4c97-a8c0-1b41de05d545 for instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 on hv-cinder-85221 Sep 01 17:38:59.347633 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-a14bc71c-ee8f-4a31-95c7-11b9813de471 req-07f8bf44-cbc2-4578-b3d0-cc348a17cc3e service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041039 Sep 01 17:38:59.348447 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 386/762] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:38:59.884611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:38:59.885346 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:38:59.891923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:59.892408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:59.892843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:59.893569 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:59.894021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:59.894445 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:59.925629 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:38:59.926106 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:38:59.926534 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:38:59.926967 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lazy-loading 'fault' on Instance uuid eea8f35b-6c91-4f1c-8671-1b47c2e93e20 {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:38:59.971784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:38:59.979960 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7544bfb4-a5f9-4296-a041-53d1e64a1fc7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 200 len: 1340 microversion: 2.1 time: 0.099748 Sep 01 17:38:59.980524 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 377/763] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:38:59 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 1340 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:01.002285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:01.003026 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: eea8f35b-6c91-4f1c-8671-1b47c2e93e20] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:01.009745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:01.010226 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:01.010664 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:01.011345 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:01.011798 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:01.012221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:01.025944 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] HTTP exception thrown: Instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 could not be found. Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Request method failure captured: Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 HTTP/1.1 Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxmaj4UJdfALJiK6W9WL56J0LdsNmogXNfbKS_awQ7no9izWJEl9HWo6Ush6H19mJYyYDfxKKkamKzF82tUc5Tu2yX8ZDJ9rNQwbMa2Na4mJPZDvYqNumOFEJJ1x14D5tKji2TeaJZUgIGvH6LP_eUoyrI7Q-zAjvyRnIuZd2f_3Y8 Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:39:01.027522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_79c90aaff0a44b278807167fdbd38e48", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}] Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: d364c74791fc4cd4af6773433a7a13cc Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 could not be found. Sep 01 17:39:01.029262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'eea8f35b-6c91-4f1c-8671-1b47c2e93e20'} Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 could not be found. Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:39:01.030154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 could not be found. Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 could not be found. Sep 01 17:39:01.031638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:01.033033 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Returning 404 to user: Instance eea8f35b-6c91-4f1c-8671-1b47c2e93e20 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:39:01.033033 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3f3fc54c-6b5c-470c-bb92-7827c308c1c6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20" status: 404 len: 111 microversion: 2.1 time: 0.031421 Sep 01 17:39:01.033033 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 387/764] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:00 2022] GET /compute/v2.1/servers/eea8f35b-6c91-4f1c-8671-1b47c2e93e20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:39:01.037603 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3ee4caf0-2a72-400b-8cff-eb47df5a3292 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '.version_select at 0x7fb8565b3f70>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:01.056156 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3ee4caf0-2a72-400b-8cff-eb47df5a3292 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918740642" status: 202 len: 0 microversion: 2.1 time: 0.022334 Sep 01 17:39:01.056745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 378/765] 10.222.0.102 () {58 vars in 1226 bytes} [Thu Sep 1 17:39:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918740642 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:39:03.913649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:03.914180 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:03.920557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:03.921031 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:03.921511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:03.922204 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:03.922658 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:03.923082 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:03.948389 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:39:04.019547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8b899a1e-ffc0-4112-9267-c1f5a47d8ee6 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "DELETE /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 204 len: 0 microversion: 2.1 time: 0.109549 Sep 01 17:39:04.020124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 388/766] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:39:03 2022] DELETE /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:39:04.029109 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:04.029831 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:04.036976 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:04.037492 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:04.037930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:04.038624 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:04.039082 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:04.039508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:04.168087 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:04.175821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f484186d-44c9-4ae5-b01c-bf4044f3f85e tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1511 microversion: 2.1 time: 0.151120 Sep 01 17:39:04.176385 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 379/767] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:04 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:05.197770 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:05.198381 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:05.205591 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:05.206081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:05.206516 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:05.207245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:05.207673 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:05.208107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:05.346565 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:05.354840 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ff7fcdd7-9176-48fb-9d02-8895b147a2bc tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1511 microversion: 2.1 time: 0.162251 Sep 01 17:39:05.356605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 389/768] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:05 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:05.730775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-c0c59cc0-184c-4fb6-b7c4-6212a2ad9113 req-d18ae33f-6c78-4e3d-853d-33bf58c5946c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231831c1-c79e-41c4-876b-bc6e8be8aa3f", "name": "network-vif-deleted", "tag": "41081b73-d685-4bd4-9f3d-2c08efd343a7"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:05.742771 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c0c59cc0-184c-4fb6-b7c4-6212a2ad9113 req-d18ae33f-6c78-4e3d-853d-33bf58c5946c service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:05.743223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c0c59cc0-184c-4fb6-b7c4-6212a2ad9113 req-d18ae33f-6c78-4e3d-853d-33bf58c5946c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:05.743775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c0c59cc0-184c-4fb6-b7c4-6212a2ad9113 req-d18ae33f-6c78-4e3d-853d-33bf58c5946c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:05.756513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-c0c59cc0-184c-4fb6-b7c4-6212a2ad9113 req-d18ae33f-6c78-4e3d-853d-33bf58c5946c service nova] Creating event network-vif-deleted:41081b73-d685-4bd4-9f3d-2c08efd343a7 for instance 231831c1-c79e-41c4-876b-bc6e8be8aa3f on hv-cinder-85221 Sep 01 17:39:05.762026 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-c0c59cc0-184c-4fb6-b7c4-6212a2ad9113 req-d18ae33f-6c78-4e3d-853d-33bf58c5946c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034797 Sep 01 17:39:05.765913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 380/769] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:06.376250 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:06.376853 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:06.383914 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:06.384406 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:06.384838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:06.385573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:06.386062 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:06.386482 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:06.416720 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:06.417195 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:06.417666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:06.418110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lazy-loading 'fault' on Instance uuid 231831c1-c79e-41c4-876b-bc6e8be8aa3f {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:39:06.458348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:06.465962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ada67a3b-e2bc-45c4-9a85-0ff2e94d98d7 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 200 len: 1316 microversion: 2.1 time: 0.093580 Sep 01 17:39:06.472590 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 390/770] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:06 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 1316 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:07.486864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:07.487547 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: 231831c1-c79e-41c4-876b-bc6e8be8aa3f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:07.493654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.494130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.494555 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.495236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.495680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.496090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.509378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] HTTP exception thrown: Instance 231831c1-c79e-41c4-876b-bc6e8be8aa3f could not be found. Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Request method failure captured: Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f HTTP/1.1 Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxmaj4UJdfALJiK6W9WL56J0LdsNmogXNfbKS_awQ7no9izWJEl9HWo6Ush6H19mJYyYDfxKKkamKzF82tUc5Tu2yX8ZDJ9rNQwbMa2Na4mJPZDvYqNumOFEJJ1x14D5tKji2TeaJZUgIGvH6LP_eUoyrI7Q-zAjvyRnIuZd2f_3Y8 Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:39:07.510997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_79c90aaff0a44b278807167fdbd38e48", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}] Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: d364c74791fc4cd4af6773433a7a13cc Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 231831c1-c79e-41c4-876b-bc6e8be8aa3f could not be found. Sep 01 17:39:07.512615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '231831c1-c79e-41c4-876b-bc6e8be8aa3f'} Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 231831c1-c79e-41c4-876b-bc6e8be8aa3f could not be found. Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:39:07.513460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 231831c1-c79e-41c4-876b-bc6e8be8aa3f could not be found. Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 231831c1-c79e-41c4-876b-bc6e8be8aa3f could not be found. Sep 01 17:39:07.514716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:07.515806 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Returning 404 to user: Instance 231831c1-c79e-41c4-876b-bc6e8be8aa3f could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:39:07.515806 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ea8def79-4c46-4177-875f-cefc481a6fe2 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f" status: 404 len: 111 microversion: 2.1 time: 0.030416 Sep 01 17:39:07.515806 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 381/771] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:07 2022] GET /compute/v2.1/servers/231831c1-c79e-41c4-876b-bc6e8be8aa3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:39:07.521988 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:07.522548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:07.529072 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.529585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.530015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.530700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.531150 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.531624 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.557356 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:39:07.603684 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:07.634893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a8e8bc39-71dc-43bb-bead-bf6fda614771 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "DELETE /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 204 len: 0 microversion: 2.1 time: 0.117401 Sep 01 17:39:07.635700 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 391/772] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:39:07 2022] DELETE /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:39:07.646695 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:07.647397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:07.654157 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.654766 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.655627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.656595 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:07.657054 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:07.658192 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:07.784214 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:07.792066 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a315d504-e920-446d-ae2a-7d1c9e4deb80 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.151772 Sep 01 17:39:07.792670 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 382/773] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:07 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:08.812712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:08.813807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:08.819843 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:08.820320 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:08.820745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:08.821447 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:08.821893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:08.822309 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:08.959644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:08.967486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9cfdb795-c7a5-496f-bd7b-661f34e5a5ca tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1524 microversion: 2.1 time: 0.158895 Sep 01 17:39:08.968058 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 392/774] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:08 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1524 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:09.349279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-fef13c7c-bae0-4c4b-bdb0-d335a108462b req-e5291536-a0f9-4fea-a080-d8eb224e22c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc18513-a02d-498d-9607-46c4bbd2306a", "name": "network-vif-deleted", "tag": "628ce1e2-6bc7-43e7-a353-8dbcabd8373f"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:09.361709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fef13c7c-bae0-4c4b-bdb0-d335a108462b req-e5291536-a0f9-4fea-a080-d8eb224e22c6 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:09.362279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fef13c7c-bae0-4c4b-bdb0-d335a108462b req-e5291536-a0f9-4fea-a080-d8eb224e22c6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:09.362776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fef13c7c-bae0-4c4b-bdb0-d335a108462b req-e5291536-a0f9-4fea-a080-d8eb224e22c6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:09.375913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-fef13c7c-bae0-4c4b-bdb0-d335a108462b req-e5291536-a0f9-4fea-a080-d8eb224e22c6 service nova] Creating event network-vif-deleted:628ce1e2-6bc7-43e7-a353-8dbcabd8373f for instance efc18513-a02d-498d-9607-46c4bbd2306a on hv-cinder-85221 Sep 01 17:39:09.382687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-fef13c7c-bae0-4c4b-bdb0-d335a108462b req-e5291536-a0f9-4fea-a080-d8eb224e22c6 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038143 Sep 01 17:39:09.383599 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 383/775] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:09.989085 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:09.990051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:09.996128 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:09.996606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:09.997037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:09.997755 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:09.998207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:09.998629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:10.033574 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:10.034046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:10.034471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:10.034901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lazy-loading 'fault' on Instance uuid efc18513-a02d-498d-9607-46c4bbd2306a {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:39:10.077746 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd364c74791fc4cd4af6773433a7a13cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c90aaff0a44b278807167fdbd38e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:10.085585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ecc5d437-26a4-4fd6-a032-5391300f48ee tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 200 len: 1315 microversion: 2.1 time: 0.100757 Sep 01 17:39:10.086138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 393/776] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:09 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 1315 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:11.106529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:11.107133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] [instance: efc18513-a02d-498d-9607-46c4bbd2306a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:11.113782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:11.114260 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:11.114694 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:11.115382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:11.115835 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:11.116253 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:11.130700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] HTTP exception thrown: Instance efc18513-a02d-498d-9607-46c4bbd2306a could not be found. Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Request method failure captured: Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a HTTP/1.1 Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxmaj4UJdfALJiK6W9WL56J0LdsNmogXNfbKS_awQ7no9izWJEl9HWo6Ush6H19mJYyYDfxKKkamKzF82tUc5Tu2yX8ZDJ9rNQwbMa2Na4mJPZDvYqNumOFEJJ1x14D5tKji2TeaJZUgIGvH6LP_eUoyrI7Q-zAjvyRnIuZd2f_3Y8 Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:39:11.132286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_79c90aaff0a44b278807167fdbd38e48", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/79c90aaff0a44b278807167fdbd38e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/79c90aaff0a44b278807167fdbd38e48"}]}] Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 79c90aaff0a44b278807167fdbd38e48 Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234354250 Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: d364c74791fc4cd4af6773433a7a13cc Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234354250-project Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance efc18513-a02d-498d-9607-46c4bbd2306a could not be found. Sep 01 17:39:11.133846 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': 'efc18513-a02d-498d-9607-46c4bbd2306a'} Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc18513-a02d-498d-9607-46c4bbd2306a could not be found. Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:39:11.134713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc18513-a02d-498d-9607-46c4bbd2306a could not be found. Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc18513-a02d-498d-9607-46c4bbd2306a could not be found. Sep 01 17:39:11.136210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:11.137539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] Returning 404 to user: Instance efc18513-a02d-498d-9607-46c4bbd2306a could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:39:11.137539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-66b9622e-365a-4d8d-b6f4-fbaa298b15f0 tempest-ServerRescueNegativeTestJSON-234354250 tempest-ServerRescueNegativeTestJSON-234354250-project] 10.222.0.102 "GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a" status: 404 len: 111 microversion: 2.1 time: 0.031471 Sep 01 17:39:11.137539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 384/777] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:11 2022] GET /compute/v2.1/servers/efc18513-a02d-498d-9607-46c4bbd2306a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:39:43.181252 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1524920376"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:43.181847 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:43.184197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:43.184846 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:43.191553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:43.192053 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:43.192489 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:43.193778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:43.194239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:43.194663 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:43.320380 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.network.security_group_api [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Removing security group bc5ff52f-cef3-4335-b2f1-54b99f1ef1ae from port 25f3b950-f286-45a5-b8d5-3f23cc196f50 Sep 01 17:39:43.626805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-95dd7a96-9491-48d6-be07-24459ea87f6f tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "POST /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/action" status: 202 len: 0 microversion: 2.1 time: 0.449861 Sep 01 17:39:43.627820 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 394/778] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:39:43 2022] POST /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:39:43.639821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-95a0589e-660d-4c73-8a38-b9c5eb39793d req-87d25910-93f5-43d1-915b-13f302eed1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451901e2-e13e-410c-81fc-de147385216c", "tag": "25f3b950-f286-45a5-b8d5-3f23cc196f50"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:43.646095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:43.646706 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=30 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:39:43.651473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-95a0589e-660d-4c73-8a38-b9c5eb39793d req-87d25910-93f5-43d1-915b-13f302eed1ba service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:43.652277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-95a0589e-660d-4c73-8a38-b9c5eb39793d req-87d25910-93f5-43d1-915b-13f302eed1ba service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:43.652925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-95a0589e-660d-4c73-8a38-b9c5eb39793d req-87d25910-93f5-43d1-915b-13f302eed1ba service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:43.667515 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-95a0589e-660d-4c73-8a38-b9c5eb39793d req-87d25910-93f5-43d1-915b-13f302eed1ba service nova] Creating event network-changed:25f3b950-f286-45a5-b8d5-3f23cc196f50 for instance 451901e2-e13e-410c-81fc-de147385216c on hv-cinder-85221 Sep 01 17:39:43.684557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-95a0589e-660d-4c73-8a38-b9c5eb39793d req-87d25910-93f5-43d1-915b-13f302eed1ba service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047983 Sep 01 17:39:43.685854 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 385/779] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:44.924307 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:44.924836 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:44.931110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:44.931809 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:44.932321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:44.933087 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:44.933665 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:44.934159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:45.019200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lazy-loading 'services' on Instance uuid 451901e2-e13e-410c-81fc-de147385216c {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:39:45.090560 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7989df06-ca7e-4dc2-9ab6-b8a5e0aed4a9 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "DELETE /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments/8f7e5c7c-e3e2-4335-b757-0da7e33f208c" status: 202 len: 0 microversion: 2.1 time: 0.170657 Sep 01 17:39:45.091157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 395/780] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:39:44 2022] DELETE /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments/8f7e5c7c-e3e2-4335-b757-0da7e33f208c => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:39:45.100940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e45949ca-135e-41c1-8b41-87d9a2a5d2b7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:45.104168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e45949ca-135e-41c1-8b41-87d9a2a5d2b7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:45.110977 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e45949ca-135e-41c1-8b41-87d9a2a5d2b7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:45.111569 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e45949ca-135e-41c1-8b41-87d9a2a5d2b7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:45.112202 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e45949ca-135e-41c1-8b41-87d9a2a5d2b7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:45.113286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e45949ca-135e-41c1-8b41-87d9a2a5d2b7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:45.113771 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e45949ca-135e-41c1-8b41-87d9a2a5d2b7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:45.114399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e45949ca-135e-41c1-8b41-87d9a2a5d2b7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:45.144872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e45949ca-135e-41c1-8b41-87d9a2a5d2b7 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048882 Sep 01 17:39:45.145468 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 386/781] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:39:45 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:45.705378 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-b54e3e29-d1a8-4d69-a7cf-e1461ea0d79a req-f7acd320-9bd2-4b19-bf2b-d9ef85dbb39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451901e2-e13e-410c-81fc-de147385216c", "tag": "25f3b950-f286-45a5-b8d5-3f23cc196f50"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:45.718453 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-b54e3e29-d1a8-4d69-a7cf-e1461ea0d79a req-f7acd320-9bd2-4b19-bf2b-d9ef85dbb39c service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:45.719026 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-b54e3e29-d1a8-4d69-a7cf-e1461ea0d79a req-f7acd320-9bd2-4b19-bf2b-d9ef85dbb39c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:45.719679 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-b54e3e29-d1a8-4d69-a7cf-e1461ea0d79a req-f7acd320-9bd2-4b19-bf2b-d9ef85dbb39c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:45.732193 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-b54e3e29-d1a8-4d69-a7cf-e1461ea0d79a req-f7acd320-9bd2-4b19-bf2b-d9ef85dbb39c service nova] Creating event network-changed:25f3b950-f286-45a5-b8d5-3f23cc196f50 for instance 451901e2-e13e-410c-81fc-de147385216c on hv-cinder-85221 Sep 01 17:39:45.738246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-b54e3e29-d1a8-4d69-a7cf-e1461ea0d79a req-f7acd320-9bd2-4b19-bf2b-d9ef85dbb39c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036784 Sep 01 17:39:45.739429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 396/782] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:46.156649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ca2a163d-aad6-46a2-b044-db0bdbfe30cf tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:46.158729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ca2a163d-aad6-46a2-b044-db0bdbfe30cf tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:46.165282 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca2a163d-aad6-46a2-b044-db0bdbfe30cf tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:46.165794 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca2a163d-aad6-46a2-b044-db0bdbfe30cf tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:46.166226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca2a163d-aad6-46a2-b044-db0bdbfe30cf tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:46.166916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca2a163d-aad6-46a2-b044-db0bdbfe30cf tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:46.167390 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca2a163d-aad6-46a2-b044-db0bdbfe30cf tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:46.167807 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ca2a163d-aad6-46a2-b044-db0bdbfe30cf tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:46.197632 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ca2a163d-aad6-46a2-b044-db0bdbfe30cf tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Sep 01 17:39:46.198191 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 387/783] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:39:46 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:47.211469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-acea6c12-2d89-40ac-b976-2454614a0836 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:47.213799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-acea6c12-2d89-40ac-b976-2454614a0836 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:47.223490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acea6c12-2d89-40ac-b976-2454614a0836 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:47.224060 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acea6c12-2d89-40ac-b976-2454614a0836 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:47.224498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acea6c12-2d89-40ac-b976-2454614a0836 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:47.225194 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acea6c12-2d89-40ac-b976-2454614a0836 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:47.225705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acea6c12-2d89-40ac-b976-2454614a0836 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:47.226125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acea6c12-2d89-40ac-b976-2454614a0836 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:47.256066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-acea6c12-2d89-40ac-b976-2454614a0836 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049708 Sep 01 17:39:47.256621 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 397/784] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:39:47 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:39:47.266873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:47.267391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:47.274119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:47.274590 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:47.275022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:47.275713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:47.276168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:47.276590 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:47.355775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] HTTP exception thrown: Instance 451901e2-e13e-410c-81fc-de147385216c is not attached to volume 8f7e5c7c-e3e2-4335-b757-0da7e33f208c Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Request method failure captured: Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: DELETE /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments/8f7e5c7c-e3e2-4335-b757-0da7e33f208c HTTP/1.1 Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO1c6DmjfR1dOxnCRvkWLZW-6zStKmnk3ozmXHoRRugJgFkYMtfjX4FbeMaPQtjonqUKGWcoTR7vr2kixfulAYqtBo-P6Q-pAFFoktraOcZHQ9eBG9yeqqKrZdKq0YYeI5cGBrtaAZwdDfrCMO_4GI0JyJ8cqpJzk6bmd-dR7FXYsWo Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 9644529eb8a94aa39e326871bc7b73e1 Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-TestMinimumBasicScenario-1409434605 Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:39:47.358151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_9644529eb8a94aa39e326871bc7b73e1", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9644529eb8a94aa39e326871bc7b73e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/9644529eb8a94aa39e326871bc7b73e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9644529eb8a94aa39e326871bc7b73e1"}]}] Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-TestMinimumBasicScenario-1409434605 Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 9644529eb8a94aa39e326871bc7b73e1 Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1409434605 Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-TestMinimumBasicScenario-1409434605-project Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 333dc785d4a84d56bd33a6b305dec2f7 Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-TestMinimumBasicScenario-1409434605-project Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:39:47.359649 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 451901e2-e13e-410c-81fc-de147385216c is not attached to volume 8f7e5c7c-e3e2-4335-b757-0da7e33f208c Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'server_id': '451901e2-e13e-410c-81fc-de147385216c', 'id': '8f7e5c7c-e3e2-4335-b757-0da7e33f208c'} Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8f7e5c7c-e3e2-4335-b757-0da7e33f208c. Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:39:47.360391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 451901e2-e13e-410c-81fc-de147385216c is not attached to volume 8f7e5c7c-e3e2-4335-b757-0da7e33f208c Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 451901e2-e13e-410c-81fc-de147385216c is not attached to volume 8f7e5c7c-e3e2-4335-b757-0da7e33f208c Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:39:47.361680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Returning 404 to user: Instance 451901e2-e13e-410c-81fc-de147385216c is not attached to volume 8f7e5c7c-e3e2-4335-b757-0da7e33f208c {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:39:47.362615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ffcaa571-7fc4-4b2d-a12b-bc263430dacc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "DELETE /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments/8f7e5c7c-e3e2-4335-b757-0da7e33f208c" status: 404 len: 154 microversion: 2.1 time: 0.096657 Sep 01 17:39:47.362615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 388/785] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:39:47 2022] DELETE /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c/os-volume_attachments/8f7e5c7c-e3e2-4335-b757-0da7e33f208c => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:39:48.510552 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:48.511057 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:48.520681 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.521556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.522000 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.522707 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.523164 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.523589 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.549289 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:39:48.624979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7beb62ec-88e4-4591-8589-ef6dbdaa462c tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "DELETE /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 204 len: 0 microversion: 2.1 time: 0.117573 Sep 01 17:39:48.625785 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 398/786] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:39:48 2022] DELETE /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:39:48.635385 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:48.636003 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:48.642409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.642887 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.643318 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.644005 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:48.644450 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:48.644868 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:48.781844 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:48.790281 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-37d079f4-21a0-4f23-93db-d7c8b47686dc tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1557 microversion: 2.1 time: 0.159005 Sep 01 17:39:48.790891 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 389/787] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:48 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:39:49.814096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:49.814766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:49.821778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:49.822262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:49.822692 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:49.823383 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:49.823838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:49.824257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:49.970188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:49.978548 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-76e4bac4-14fd-4e8b-8e75-882b4aa17818 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1557 microversion: 2.1 time: 0.168717 Sep 01 17:39:49.983683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 399/788] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:49 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:51.000814 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:51.001817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:51.010481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:51.011081 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:51.011725 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:51.012939 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:51.013565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:51.014221 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:51.153906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:51.161999 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fd21e36e-c088-4642-90de-b439e79c8bb4 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1557 microversion: 2.1 time: 0.166409 Sep 01 17:39:51.162564 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 390/789] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:50 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:51.827281 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-f709b17e-1b4a-47e7-a797-c33911fa6616 req-440382d3-d515-4413-af17-ddda1f3f7e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451901e2-e13e-410c-81fc-de147385216c", "name": "network-vif-deleted", "tag": "25f3b950-f286-45a5-b8d5-3f23cc196f50"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:51.838245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f709b17e-1b4a-47e7-a797-c33911fa6616 req-440382d3-d515-4413-af17-ddda1f3f7e7e service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:51.838701 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f709b17e-1b4a-47e7-a797-c33911fa6616 req-440382d3-d515-4413-af17-ddda1f3f7e7e service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:51.839130 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f709b17e-1b4a-47e7-a797-c33911fa6616 req-440382d3-d515-4413-af17-ddda1f3f7e7e service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:51.863911 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-f709b17e-1b4a-47e7-a797-c33911fa6616 req-440382d3-d515-4413-af17-ddda1f3f7e7e service nova] Creating event network-vif-deleted:25f3b950-f286-45a5-b8d5-3f23cc196f50 for instance 451901e2-e13e-410c-81fc-de147385216c on hv-cinder-85221 Sep 01 17:39:51.869011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-f709b17e-1b4a-47e7-a797-c33911fa6616 req-440382d3-d515-4413-af17-ddda1f3f7e7e service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045761 Sep 01 17:39:51.869644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 400/790] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:52.183423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:52.184121 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:52.190737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:52.191328 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:52.191644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:52.193163 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:52.193654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:52.194071 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:52.236122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:52.236601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:52.237126 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:52.237758 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lazy-loading 'fault' on Instance uuid 451901e2-e13e-410c-81fc-de147385216c {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:39:52.288872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '333dc785d4a84d56bd33a6b305dec2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9644529eb8a94aa39e326871bc7b73e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:52.297340 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2a185de8-533f-4d0c-b7f1-65746cb68d35 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 200 len: 1352 microversion: 2.1 time: 0.118224 Sep 01 17:39:52.298449 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 391/791] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:52 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 1352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:53.320534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:53.321808 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] [instance: 451901e2-e13e-410c-81fc-de147385216c] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:53.328537 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:53.329018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:53.329472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:53.330158 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:53.330674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:53.331062 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:53.344738 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] HTTP exception thrown: Instance 451901e2-e13e-410c-81fc-de147385216c could not be found. Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Request method failure captured: Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c HTTP/1.1 Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO1c6DmjfR1dOxnCRvkWLZW-6zStKmnk3ozmXHoRRugJgFkYMtfjX4FbeMaPQtjonqUKGWcoTR7vr2kixfulAYqtBo-P6Q-pAFFoktraOcZHQ9eBG9yeqqKrZdKq0YYeI5cGBrtaAZwdDfrCMO_4GI0JyJ8cqpJzk6bmd-dR7FXYsWo Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 9644529eb8a94aa39e326871bc7b73e1 Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-TestMinimumBasicScenario-1409434605 Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:39:53.346376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_9644529eb8a94aa39e326871bc7b73e1", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9644529eb8a94aa39e326871bc7b73e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/9644529eb8a94aa39e326871bc7b73e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9644529eb8a94aa39e326871bc7b73e1"}]}] Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-TestMinimumBasicScenario-1409434605 Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 9644529eb8a94aa39e326871bc7b73e1 Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1409434605 Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-TestMinimumBasicScenario-1409434605-project Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 333dc785d4a84d56bd33a6b305dec2f7 Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-TestMinimumBasicScenario-1409434605-project Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 451901e2-e13e-410c-81fc-de147385216c could not be found. Sep 01 17:39:53.347776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '451901e2-e13e-410c-81fc-de147385216c'} Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 451901e2-e13e-410c-81fc-de147385216c could not be found. Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:39:53.349149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 451901e2-e13e-410c-81fc-de147385216c could not be found. Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 451901e2-e13e-410c-81fc-de147385216c could not be found. Sep 01 17:39:53.350678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:39:53.352143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Returning 404 to user: Instance 451901e2-e13e-410c-81fc-de147385216c could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:39:53.352143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0a2fe038-ec98-4cb5-8828-9b2368900f52 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c" status: 404 len: 111 microversion: 2.1 time: 0.032551 Sep 01 17:39:53.352143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 401/792] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:53 2022] GET /compute/v2.1/servers/451901e2-e13e-410c-81fc-de147385216c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:39:53.356377 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7f5058ab-2951-44e0-b5b8-e59ff4213284 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] Calling method '.version_select at 0x7fb85677eca0>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:53.374983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7f5058ab-2951-44e0-b5b8-e59ff4213284 tempest-TestMinimumBasicScenario-1409434605 tempest-TestMinimumBasicScenario-1409434605-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-226298924" status: 202 len: 0 microversion: 2.1 time: 0.022336 Sep 01 17:39:53.375543 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 392/793] 10.222.0.102 () {58 vars in 1274 bytes} [Thu Sep 1 17:39:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-226298924 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 17:39:54.772348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1554338450", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:54.830421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] validate_networks() for None {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:39:55.114753 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:39:55.115427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:39:55.115959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:39:55.116388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:39:55.117011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:39:55.126399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:55.126877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:55.127301 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:55.128011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:55.128455 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:55.128870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:55.146468 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Getting quotas for project fd4ba94e5d9a4bf185bbbdf5e4c84ce8. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:39:55.150409 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Getting quotas for user 44f3a9807c30494f93e52147967ddb3a and project fd4ba94e5d9a4bf185bbbdf5e4c84ce8. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:39:55.161877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:39:55.164185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:39:55.218680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e5394321-df41-4257-af9b-539c88064cff tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.450157 Sep 01 17:39:55.219323 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 402/794] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:39:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:39:55.231941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f8f045dd-0de5-41f4-a339-02dd664fa481 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:55.232739 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f8f045dd-0de5-41f4-a339-02dd664fa481 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:55.345604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f8f045dd-0de5-41f4-a339-02dd664fa481 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:55.359996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f8f045dd-0de5-41f4-a339-02dd664fa481 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1219 microversion: 2.1 time: 0.132187 Sep 01 17:39:55.361273 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 393/795] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:55 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:56.384996 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:56.385751 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:56.392301 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:56.392874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:56.393405 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:56.394168 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:56.394697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:56.395776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:56.653591 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:56.664177 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-907e8ffd-dad9-4a02-9a32-f8e1196957d4 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1271 microversion: 2.1 time: 0.281991 Sep 01 17:39:56.665634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 403/796] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:56 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:57.692364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:57.694191 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:57.704613 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:57.705493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:57.707017 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:57.708435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:57.709059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:57.710391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:58.304324 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:58.314880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8ff381a6-019d-4991-8f47-32cb46832581 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1319 microversion: 2.1 time: 0.629357 Sep 01 17:39:58.315475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 394/797] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:57 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1319 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:39:59.237993 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-fd6a0349-affb-499a-b3c1-607bcefaf08c req-5c10a5f0-f0ee-4797-b383-5749242175ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d482978-d369-404f-aae5-047a43732e03", "tag": "e94d78c7-2dc6-4c67-98b3-462aed40470d"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:39:59.248015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-fd6a0349-affb-499a-b3c1-607bcefaf08c req-5c10a5f0-f0ee-4797-b383-5749242175ad service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:59.248652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-fd6a0349-affb-499a-b3c1-607bcefaf08c req-5c10a5f0-f0ee-4797-b383-5749242175ad service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:59.249082 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-fd6a0349-affb-499a-b3c1-607bcefaf08c req-5c10a5f0-f0ee-4797-b383-5749242175ad service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:59.260404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-fd6a0349-affb-499a-b3c1-607bcefaf08c req-5c10a5f0-f0ee-4797-b383-5749242175ad service nova] Creating event network-changed:e94d78c7-2dc6-4c67-98b3-462aed40470d for instance 7d482978-d369-404f-aae5-047a43732e03 on hv-cinder-85221 Sep 01 17:39:59.265131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-fd6a0349-affb-499a-b3c1-607bcefaf08c req-5c10a5f0-f0ee-4797-b383-5749242175ad service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030853 Sep 01 17:39:59.266290 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 404/798] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:39:59.339849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:39:59.340488 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:39:59.347467 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:59.347968 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:59.348396 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:59.349177 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:39:59.349665 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:39:59.350075 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:39:59.647637 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:39:59.656472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a17e18c4-607e-4df6-9fe9-aae26320ecf5 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1319 microversion: 2.1 time: 0.320475 Sep 01 17:39:59.657186 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 395/799] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:39:59 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:00.677713 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:00.678393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:00.684736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:00.685557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:00.686061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:00.686830 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:00.687352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:00.687838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:00.837377 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:00.845041 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0122170e-3d80-4540-a45c-e7435a205a29 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1319 microversion: 2.1 time: 0.172051 Sep 01 17:40:00.845627 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 405/800] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:00 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:01.866690 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:01.867864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:01.874706 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:01.875192 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:01.875624 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:01.876805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:01.877627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:01.878060 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.035092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:02.044993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5eb7c800-9e3c-4c93-b187-11ed14b37a66 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1319 microversion: 2.1 time: 0.183052 Sep 01 17:40:02.045597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 396/801] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:01 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:02.386106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-dee15232-89de-4f62-ab63-27c6600ca6be tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:02.388552 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-dee15232-89de-4f62-ab63-27c6600ca6be tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:02.395559 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dee15232-89de-4f62-ab63-27c6600ca6be tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.396675 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dee15232-89de-4f62-ab63-27c6600ca6be tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.397119 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dee15232-89de-4f62-ab63-27c6600ca6be tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.397846 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dee15232-89de-4f62-ab63-27c6600ca6be tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.398354 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dee15232-89de-4f62-ab63-27c6600ca6be tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.398717 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dee15232-89de-4f62-ab63-27c6600ca6be tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.427550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-dee15232-89de-4f62-ab63-27c6600ca6be tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045437 Sep 01 17:40:02.428099 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 406/802] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:40:02 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:40:02.504270 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:02.504877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:02.511783 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.512622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.513233 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.514120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.514585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.515016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.543503 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Going to try to terminate instance {{(pid=121745) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:40:02.644688 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-dc9c95f8-400d-436e-b2ab-e96fb967de87 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "DELETE /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 204 len: 0 microversion: 2.1 time: 0.145623 Sep 01 17:40:02.645378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 397/803] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:40:02 2022] DELETE /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:40:02.655507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:02.656179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:02.663191 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.664014 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.664674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.665665 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:02.666348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:02.667144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:02.801141 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:02.809178 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7ac1854b-3d94-4a0f-80ca-6f39cc4d9ec7 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1676 microversion: 2.1 time: 0.159480 Sep 01 17:40:02.810103 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 407/804] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:02 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:03.067326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:03.068108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:03.074497 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:03.075075 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:03.075949 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:03.076621 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:03.077224 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:03.077806 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:03.223228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:03.231456 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2f37232e-0b5d-4527-8cfb-f1f205881a35 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1319 microversion: 2.1 time: 0.169044 Sep 01 17:40:03.232041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 398/805] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:03 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:03.830803 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:03.831453 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:03.838079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:03.838562 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:03.838996 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:03.839683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:03.840138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:03.840557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:03.972055 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:03.980615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0ca74b7e-4ba7-4143-bb68-5fd329ab5f22 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1676 microversion: 2.1 time: 0.153687 Sep 01 17:40:03.981179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 408/806] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:03 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:04.251872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:04.252474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:04.258790 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:04.259264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:04.259689 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:04.260395 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:04.260840 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:04.261256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:04.389902 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:04.397987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cc8e899d-7e1c-4f4c-95d9-927309f2aa4e tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1319 microversion: 2.1 time: 0.150030 Sep 01 17:40:04.398540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 399/807] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:04 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:05.002504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:05.003124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:05.009537 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:05.010039 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:05.010455 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:05.011143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:05.011591 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:05.012010 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:05.137112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:05.147102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:05.157134 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-969bab37-f0dd-44d3-94a2-abe1acabd6c3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1676 microversion: 2.1 time: 0.158465 Sep 01 17:40:05.157729 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 409/808] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:04 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:05.418952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:05.419602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:05.423389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:05.427896 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:05.428490 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:05.429084 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:05.429993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:05.430447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:05.430866 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:05.540488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-4348ba71-f798-4bf8-9f20-ea696e14775f req-2b4ec5cb-ab76-472b-9f21-494a95071548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14064865-1bc2-4b27-993b-cd5e726de947", "name": "network-vif-deleted", "tag": "e42b846f-2457-41ca-a620-122194a4dfd4"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:05.549716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:05.552229 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-4348ba71-f798-4bf8-9f20-ea696e14775f req-2b4ec5cb-ab76-472b-9f21-494a95071548 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:05.552723 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-4348ba71-f798-4bf8-9f20-ea696e14775f req-2b4ec5cb-ab76-472b-9f21-494a95071548 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:05.553110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-4348ba71-f798-4bf8-9f20-ea696e14775f req-2b4ec5cb-ab76-472b-9f21-494a95071548 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:05.573697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-4348ba71-f798-4bf8-9f20-ea696e14775f req-2b4ec5cb-ab76-472b-9f21-494a95071548 service nova] Creating event network-vif-deleted:e42b846f-2457-41ca-a620-122194a4dfd4 for instance 14064865-1bc2-4b27-993b-cd5e726de947 on hv-cinder-85221 Sep 01 17:40:05.579232 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-4348ba71-f798-4bf8-9f20-ea696e14775f req-2b4ec5cb-ab76-472b-9f21-494a95071548 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042706 Sep 01 17:40:05.580191 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 410/809] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:05.668435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:05.676810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0ab96936-514d-4e70-9b2f-1a0679d280e0 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1319 microversion: 2.1 time: 0.261699 Sep 01 17:40:05.677710 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 400/810] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:05 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:06.180778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:06.181509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:06.187957 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.188442 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.188873 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.189599 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.190056 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.190483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.223315 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.223794 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.224231 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.224673 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lazy-loading 'fault' on Instance uuid 14064865-1bc2-4b27-993b-cd5e726de947 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:40:06.268331 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:06.276073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-eace8f48-dc8a-4bd1-aa2a-175c6f16b8a1 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 200 len: 1330 microversion: 2.1 time: 0.100757 Sep 01 17:40:06.276625 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 411/811] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:06 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:06.697564 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:06.698174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:06.704697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.705171 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.705635 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.706312 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.706760 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.707807 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.841657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:06.850189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d2da5d0e-9cd2-4a24-a72b-b4e838d4df23 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1319 microversion: 2.1 time: 0.156446 Sep 01 17:40:06.851357 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 401/812] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:06 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:06.891108 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-8e9868ae-85c5-407d-a281-846727c51580 req-6aa04448-cf79-4c8f-a3bd-c80b8ebd69ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d482978-d369-404f-aae5-047a43732e03", "name": "network-vif-plugged", "status": "completed", "tag": "e94d78c7-2dc6-4c67-98b3-462aed40470d"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:06.902421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-8e9868ae-85c5-407d-a281-846727c51580 req-6aa04448-cf79-4c8f-a3bd-c80b8ebd69ef service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:06.902888 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-8e9868ae-85c5-407d-a281-846727c51580 req-6aa04448-cf79-4c8f-a3bd-c80b8ebd69ef service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:06.903311 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-8e9868ae-85c5-407d-a281-846727c51580 req-6aa04448-cf79-4c8f-a3bd-c80b8ebd69ef service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:06.907432 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:06.915526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-8e9868ae-85c5-407d-a281-846727c51580 req-6aa04448-cf79-4c8f-a3bd-c80b8ebd69ef service nova] Creating event network-vif-plugged:e94d78c7-2dc6-4c67-98b3-462aed40470d for instance 7d482978-d369-404f-aae5-047a43732e03 on hv-cinder-85221 Sep 01 17:40:06.920723 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-8e9868ae-85c5-407d-a281-846727c51580 req-6aa04448-cf79-4c8f-a3bd-c80b8ebd69ef service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033466 Sep 01 17:40:06.921328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 412/813] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:40:07.296994 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:07.297654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:07.304039 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:07.304520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:07.304956 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:07.305665 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:07.306118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:07.306561 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:07.310535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:07.321659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] HTTP exception thrown: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Request method failure captured: Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 HTTP/1.1 Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOzFHa03N2OcQ4ZycXCiMUAiFuFh9RrmOnws7LbVcWWwX_7SIhSI6Gk0JzOi2V9UMhNi-VCR2-CCpf7nO3bNNqEspJ-3SbPOQaRQSnKVbgWWu1i9rh-TxKxMT8muqDtLkVFPtMeYfYLLAzmf1SsejQNQDO0pIdjFvL__AZwuY9wPTVU Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:40:07.323283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_19bb1cbe315441258828677997dd6fdf", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}] Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: ae0aab3e503249d49ff9473b4990ff63 Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:40:07.324655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '14064865-1bc2-4b27-993b-cd5e726de947'} Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:40:07.325749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:40:07.327045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:07.328111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Returning 404 to user: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:40:07.328111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cdb89bda-e739-4264-a1ed-04f701121bdd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 404 len: 111 microversion: 2.1 time: 0.031744 Sep 01 17:40:07.328111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 402/814] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:07 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:40:07.335501 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-69a04963-27a0-4a42-9d35-ed78fe5d6cce tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '.version_select at 0x7fb8565d7ee0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:07.356172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-69a04963-27a0-4a42-9d35-ed78fe5d6cce tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823764669" status: 202 len: 0 microversion: 2.1 time: 0.025215 Sep 01 17:40:07.356714 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 413/815] 10.222.0.102 () {58 vars in 1226 bytes} [Thu Sep 1 17:40:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823764669 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:40:07.874079 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:07.874765 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:07.883009 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:07.883490 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:07.883914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:07.884606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:07.885049 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:07.885502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:07.989997 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-942b592f-8f3e-4760-818f-d4e95c9087dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'create', calling method: .version_select at 0x7fb8565d7e50>, body: {"keypair": {"name": "tempest-keypair-426026503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHs9z2Br7aWzqnLRZIObx8/fxociaGwVp5rSFRC2JDocIWczNglrL92xCxUAfrg90qPM8F16BlIldgRY11q5FyrMZmmUpNq609Jjg0e7ZYbm4yS4/vhNwgESXmqIaznU9g=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:08.006298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-942b592f-8f3e-4760-818f-d4e95c9087dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Getting quotas for project 19bb1cbe315441258828677997dd6fdf. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:40:08.010162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-942b592f-8f3e-4760-818f-d4e95c9087dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Getting quotas for user ae0aab3e503249d49ff9473b4990ff63 and project 19bb1cbe315441258828677997dd6fdf. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:40:08.026960 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:08.033957 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-942b592f-8f3e-4760-818f-d4e95c9087dd tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048380 Sep 01 17:40:08.034552 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 414/816] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:40:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:08.036223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b23babae-c746-4ba7-8eef-ad9ed4d5ae90 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1319 microversion: 2.1 time: 0.168496 Sep 01 17:40:08.036778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 403/817] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:07 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:09.057989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:09.058849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:09.065014 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:09.065534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:09.065967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:09.066662 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:09.067114 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:09.067535 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:09.204862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:09.212932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-93af51e6-c428-4507-bfe0-938bfee02b7f tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1469 microversion: 2.1 time: 0.160275 Sep 01 17:40:09.213812 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 415/818] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:09 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:09.258960 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:09.259449 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:09.265665 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:09.266144 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:09.266577 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:09.267261 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:09.267712 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:09.268359 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:09.294758 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Going to try to terminate instance {{(pid=121745) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:40:09.319476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-241576724", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95c61e6e-7ee9-458f-a829-4d93850ed5e5"}], "security_groups": [{"name": "tempest-securitygroup--2106207796"}], "key_name": "tempest-keypair-426026503", "user_data": "}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:09.375667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cee34abd-9f3b-4773-88a8-9a6cc529ce58 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "DELETE /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 204 len: 0 microversion: 2.1 time: 0.120197 Sep 01 17:40:09.380397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 404/819] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:40:09 2022] DELETE /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:40:09.385845 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:09.386540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:09.392257 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:09.392734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:09.393173 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:09.393885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:09.394363 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:09.394786 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:09.424832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] validate_networks() for [('95c61e6e-7ee9-458f-a829-4d93850ed5e5', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:40:09.524028 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:09.531855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-20143824-9d8c-4b36-860b-f939cd27d830 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1475 microversion: 2.1 time: 0.150291 Sep 01 17:40:09.532424 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 405/820] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:09 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1475 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:09.879837 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:40:09.880254 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:40:09.880720 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:40:09.881180 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:40:09.881623 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:40:09.890529 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:09.891001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:09.891424 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:09.892133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:09.892583 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:09.892999 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:09.909629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Getting quotas for project 19bb1cbe315441258828677997dd6fdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:40:09.915345 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Getting quotas for user ae0aab3e503249d49ff9473b4990ff63 and project 19bb1cbe315441258828677997dd6fdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:40:09.925250 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:40:09.928243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:40:09.975986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-eea31a6a-bbdd-4972-a888-534e42bea5c6 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.661232 Sep 01 17:40:09.976620 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 416/821] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:40:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 01 17:40:09.987585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5e682ea2-1855-4051-96c7-2643e78598d5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:09.988801 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5e682ea2-1855-4051-96c7-2643e78598d5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:10.042648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5e682ea2-1855-4051-96c7-2643e78598d5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:10.050200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5e682ea2-1855-4051-96c7-2643e78598d5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1240 microversion: 2.1 time: 0.066579 Sep 01 17:40:10.051315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 406/822] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:09 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:10.552110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:10.552720 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:10.559958 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:10.560452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:10.560862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:10.561567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:10.562015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:10.562431 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:10.690186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:10.698468 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2c24d1bf-028f-441c-8b45-d15d505f3bf3 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1475 microversion: 2.1 time: 0.150328 Sep 01 17:40:10.699028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 417/823] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:10 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1475 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:11.071692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:11.072233 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:11.079610 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.080090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.080517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.081196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.081673 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.082091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.144625 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:11.152296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-83433eff-5623-4d74-b653-75c17ec63cd5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1292 microversion: 2.1 time: 0.084582 Sep 01 17:40:11.152857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 407/824] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:11 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:11.720212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:11.721453 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:11.728167 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:11.730388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.730885 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.731317 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.732434 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.732888 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.733760 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.815384 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-32ed3a84-724a-4c06-9c27-8f345df4e4a0 req-9578cde0-d235-41c1-a5fd-ca2f6e822956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d482978-d369-404f-aae5-047a43732e03", "name": "network-vif-deleted", "tag": "e94d78c7-2dc6-4c67-98b3-462aed40470d"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:11.827300 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f3a9807c30494f93e52147967ddb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4ba94e5d9a4bf185bbbdf5e4c84ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:11.833388 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-32ed3a84-724a-4c06-9c27-8f345df4e4a0 req-9578cde0-d235-41c1-a5fd-ca2f6e822956 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:11.834417 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-32ed3a84-724a-4c06-9c27-8f345df4e4a0 req-9578cde0-d235-41c1-a5fd-ca2f6e822956 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:11.835015 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-32ed3a84-724a-4c06-9c27-8f345df4e4a0 req-9578cde0-d235-41c1-a5fd-ca2f6e822956 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:11.836773 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-de1b4929-13de-48f4-b426-9ce42762e725 tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 200 len: 1433 microversion: 2.1 time: 0.120456 Sep 01 17:40:11.837683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 418/825] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:11 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 1433 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:11.862598 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-32ed3a84-724a-4c06-9c27-8f345df4e4a0 req-9578cde0-d235-41c1-a5fd-ca2f6e822956 service nova] Creating event network-vif-deleted:e94d78c7-2dc6-4c67-98b3-462aed40470d for instance 7d482978-d369-404f-aae5-047a43732e03 on hv-cinder-85221 Sep 01 17:40:11.869052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-32ed3a84-724a-4c06-9c27-8f345df4e4a0 req-9578cde0-d235-41c1-a5fd-ca2f6e822956 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068491 Sep 01 17:40:11.870431 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 408/826] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:12.173274 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:12.173908 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:12.180664 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:12.181153 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:12.181615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:12.182312 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:12.182764 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:12.183188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:12.249024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:12.256934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-bcd007e0-ccbe-4995-8f37-307c6b3a0afb tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1298 microversion: 2.1 time: 0.087495 Sep 01 17:40:12.257539 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 419/827] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:12 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:12.859312 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:12.859934 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] [instance: 7d482978-d369-404f-aae5-047a43732e03] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:12.867172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:12.867653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:12.868084 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:12.868776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:12.869221 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:12.869660 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:12.884439 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] HTTP exception thrown: Instance 7d482978-d369-404f-aae5-047a43732e03 could not be found. Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Request method failure captured: Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 HTTP/1.1 Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO5pDKcOEf-BYC1aOQULrJjClU6Ic-EOb8FB1YwgWzmGrnu5bFTPs-ohZ6gKTVBoupEprimbwfNKjN71VCdROp5_hgi99j2puBFn2Kxx1_ETcRgxn1kO09z1Oy6k4JApQJAXeQCyKXuP6HwV1k_0ec65T58gKWYVNQmM8Hk9V7l-ja4 Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: fd4ba94e5d9a4bf185bbbdf5e4c84ce8 Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-VolumesNegativeTest-2038463782 Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:40:12.886133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_fd4ba94e5d9a4bf185bbbdf5e4c84ce8", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/fd4ba94e5d9a4bf185bbbdf5e4c84ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/fd4ba94e5d9a4bf185bbbdf5e4c84ce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/fd4ba94e5d9a4bf185bbbdf5e4c84ce8"}]}] Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-VolumesNegativeTest-2038463782 Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: fd4ba94e5d9a4bf185bbbdf5e4c84ce8 Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-VolumesNegativeTest-2038463782 Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-VolumesNegativeTest-2038463782-project Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 44f3a9807c30494f93e52147967ddb3a Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-VolumesNegativeTest-2038463782-project Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 7d482978-d369-404f-aae5-047a43732e03 could not be found. Sep 01 17:40:12.887672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '7d482978-d369-404f-aae5-047a43732e03'} Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d482978-d369-404f-aae5-047a43732e03 could not be found. Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:40:12.893745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d482978-d369-404f-aae5-047a43732e03 could not be found. Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d482978-d369-404f-aae5-047a43732e03 could not be found. Sep 01 17:40:12.895201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:40:12.896482 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] Returning 404 to user: Instance 7d482978-d369-404f-aae5-047a43732e03 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:40:12.896482 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9d2f6ddf-00d7-4e99-8b54-c9fcfb358bda tempest-VolumesNegativeTest-2038463782 tempest-VolumesNegativeTest-2038463782-project] 10.222.0.102 "GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03" status: 404 len: 111 microversion: 2.1 time: 0.033117 Sep 01 17:40:12.896482 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 409/828] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:12 2022] GET /compute/v2.1/servers/7d482978-d369-404f-aae5-047a43732e03 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:40:13.278654 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:13.279187 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:13.286848 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:13.287328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:13.287756 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:13.288656 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:13.289110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:13.289553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:13.438074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:13.446029 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-df8346d7-6024-4cd2-9b59-eb913f960fb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1366 microversion: 2.1 time: 0.171173 Sep 01 17:40:13.446805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 420/829] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:13 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:13.891188 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-fd5bc7a1-8bf8-4ec0-b99f-727f1c641ab8 req-a88402af-b15d-40cd-90df-70270c3bf39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84b9974e-1129-41ba-8a64-383db67ca891", "tag": "c41b96e8-8833-4515-b4c4-0fea0ffe7475"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:13.900192 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:13.908363 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fd5bc7a1-8bf8-4ec0-b99f-727f1c641ab8 req-a88402af-b15d-40cd-90df-70270c3bf39f service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:13.908929 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fd5bc7a1-8bf8-4ec0-b99f-727f1c641ab8 req-a88402af-b15d-40cd-90df-70270c3bf39f service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:13.909451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fd5bc7a1-8bf8-4ec0-b99f-727f1c641ab8 req-a88402af-b15d-40cd-90df-70270c3bf39f service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:13.922585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-fd5bc7a1-8bf8-4ec0-b99f-727f1c641ab8 req-a88402af-b15d-40cd-90df-70270c3bf39f service nova] Creating event network-changed:c41b96e8-8833-4515-b4c4-0fea0ffe7475 for instance 84b9974e-1129-41ba-8a64-383db67ca891 on hv-cinder-85221 Sep 01 17:40:13.927476 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-fd5bc7a1-8bf8-4ec0-b99f-727f1c641ab8 req-a88402af-b15d-40cd-90df-70270c3bf39f service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040111 Sep 01 17:40:13.928456 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 410/830] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:14.466971 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:14.467574 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:14.473992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:14.474471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:14.474878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:14.475557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:14.476004 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:14.476417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:14.611155 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:14.619937 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-66d628ad-fa3c-4699-b2bd-b50ebe044659 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1366 microversion: 2.1 time: 0.156722 Sep 01 17:40:14.620494 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 421/831] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:14 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:15.643274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:15.643971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:15.650077 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:15.650556 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:15.650987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:15.651664 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:15.652113 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:15.652532 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:15.783223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:15.791349 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-80060f0d-1bf1-48c3-8bd7-79aaf4a72da3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1366 microversion: 2.1 time: 0.153024 Sep 01 17:40:15.791959 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 411/832] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:15 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:16.813747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:16.815585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:16.822765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:16.823328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:16.823835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:16.824988 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:16.825505 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:16.825912 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:16.957916 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:16.966102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-96b7a4db-da24-435e-83d5-ea75172f2568 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1366 microversion: 2.1 time: 0.157253 Sep 01 17:40:16.966679 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 422/833] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:16 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:17.988441 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:17.989056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:17.995098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.995576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.996009 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:17.996698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:17.997148 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:17.997591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:18.132341 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:18.140172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6bc6e0ab-fabd-4c51-af96-78eefdf259cc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1366 microversion: 2.1 time: 0.156460 Sep 01 17:40:18.140741 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 412/834] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:17 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:19.163682 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:19.164589 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:19.177702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.178203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.178649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:19.179392 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:19.179985 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:19.180874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:19.320370 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:19.328698 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c1462fae-11ac-4264-8c20-fc5530a8906b tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1366 microversion: 2.1 time: 0.170010 Sep 01 17:40:19.329286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 423/835] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:19 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:20.268968 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-510003511", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "networks": [{"uuid": "58f5e15b-23b8-485a-8903-cd250c9d2485"}]}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:20.277710 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:20.323638 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] validate_networks() for [('58f5e15b-23b8-485a-8903-cd250c9d2485', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:40:20.350305 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:20.350922 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:20.352957 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:20.353653 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=10 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:20.360622 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:20.361121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:20.361584 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:20.362378 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:20.362838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:20.363268 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:20.492725 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:20.500599 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7a5bcda9-6abc-4904-869e-01e8d3031e5a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1366 microversion: 2.1 time: 0.154777 Sep 01 17:40:20.501157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 424/836] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:20 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:20.686662 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:40:20.687075 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:40:20.687539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:40:20.687935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:40:20.688332 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:40:20.697586 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:20.698056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:20.698477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:20.699187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:20.699894 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:20.700307 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:20.718527 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Getting quotas for project 41b4d9513f204230a8ff27614eb1a642. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:40:20.722535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Getting quotas for user d09949305dc04d658d20ec90798aff3c and project 41b4d9513f204230a8ff27614eb1a642. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:40:20.733478 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:40:20.735776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:40:20.782607 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0431a0d8-46ee-4f81-bc67-e775ea81ffa5 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.517847 Sep 01 17:40:20.783597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 413/837] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:40:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:40:20.794311 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-87e0a4cd-b1a0-4642-9ead-5acdaf66bd03 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:20.795367 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-87e0a4cd-b1a0-4642-9ead-5acdaf66bd03 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:20.860523 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-87e0a4cd-b1a0-4642-9ead-5acdaf66bd03 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:20.867754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-87e0a4cd-b1a0-4642-9ead-5acdaf66bd03 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1222 microversion: 2.1 time: 0.077353 Sep 01 17:40:20.868325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 425/838] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:20 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:20.890007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-4bf5d925-7332-46d6-8ae9-95521ba9c9d6 req-50b9b1a1-c4a5-4189-b120-705c54c9a04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b9974e-1129-41ba-8a64-383db67ca891", "name": "network-vif-plugged", "status": "completed", "tag": "c41b96e8-8833-4515-b4c4-0fea0ffe7475"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:20.901473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-4bf5d925-7332-46d6-8ae9-95521ba9c9d6 req-50b9b1a1-c4a5-4189-b120-705c54c9a04f service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:20.902026 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-4bf5d925-7332-46d6-8ae9-95521ba9c9d6 req-50b9b1a1-c4a5-4189-b120-705c54c9a04f service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:20.902373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-4bf5d925-7332-46d6-8ae9-95521ba9c9d6 req-50b9b1a1-c4a5-4189-b120-705c54c9a04f service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:20.913848 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-4bf5d925-7332-46d6-8ae9-95521ba9c9d6 req-50b9b1a1-c4a5-4189-b120-705c54c9a04f service nova] Creating event network-vif-plugged:c41b96e8-8833-4515-b4c4-0fea0ffe7475 for instance 84b9974e-1129-41ba-8a64-383db67ca891 on hv-cinder-85221 Sep 01 17:40:20.918940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-4bf5d925-7332-46d6-8ae9-95521ba9c9d6 req-50b9b1a1-c4a5-4189-b120-705c54c9a04f service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Sep 01 17:40:20.919530 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 414/839] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:40:21.525867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:21.526385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:21.532814 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:21.533287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:21.533752 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:21.534458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:21.534902 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:21.535318 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:21.664770 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:21.672706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-aecc0eed-d17f-4eac-804d-ccc0be3f6937 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1366 microversion: 2.1 time: 0.150818 Sep 01 17:40:21.673278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 426/840] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:21 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:21.889050 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:21.889804 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:21.896010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:21.896493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:21.896926 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:21.897647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:21.898098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:21.898526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:21.958997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:21.966566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d52bcf10-4739-4dc7-af02-42f056d8ef97 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1218 microversion: 2.1 time: 0.082262 Sep 01 17:40:21.967130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 415/841] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:21 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:22.694726 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:22.695370 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:22.702280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:22.702705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:22.703136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:22.703823 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:22.704303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:22.704722 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:22.833886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:22.841605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e22bfc84-f8d5-4d95-a43c-2997f5d53348 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1366 microversion: 2.1 time: 0.150723 Sep 01 17:40:22.842162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 427/842] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:22 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:22.987105 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:22.987684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:22.995249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:22.996001 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:22.996620 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:22.997341 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:22.997791 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:22.998394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:23.066067 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:23.073748 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-70d31dea-57c1-4be2-b12a-ce6eee84d157 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1274 microversion: 2.1 time: 0.090657 Sep 01 17:40:23.074570 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 416/843] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:22 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:23.862322 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:23.863113 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:23.869775 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:23.870394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:23.870995 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:23.872205 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:23.872675 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:23.873136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.007011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:24.014977 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-27ed132a-9fdb-4678-9d89-f4d0aaed5104 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1551 microversion: 2.1 time: 0.156645 Sep 01 17:40:24.015539 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 428/844] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:23 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:24.035369 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-723209fc-7e5c-4eab-9581-577e4b16f53d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:24.035912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-723209fc-7e5c-4eab-9581-577e4b16f53d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:24.042270 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-723209fc-7e5c-4eab-9581-577e4b16f53d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.042752 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-723209fc-7e5c-4eab-9581-577e4b16f53d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.043190 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-723209fc-7e5c-4eab-9581-577e4b16f53d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.043911 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-723209fc-7e5c-4eab-9581-577e4b16f53d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.044386 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-723209fc-7e5c-4eab-9581-577e4b16f53d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.044824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-723209fc-7e5c-4eab-9581-577e4b16f53d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.095112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:24.096020 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:24.102326 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.102833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.103243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.103936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:24.104385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:24.104800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:24.147961 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-723209fc-7e5c-4eab-9581-577e4b16f53d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116779 Sep 01 17:40:24.148864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 417/845] 10.222.0.102 () {58 vars in 1280 bytes} [Thu Sep 1 17:40:24 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:24.167237 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:24.175803 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-514724a0-b04f-4c55-b9c8-69004ca909c7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1280 microversion: 2.1 time: 0.084623 Sep 01 17:40:24.176887 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 429/846] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:24 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:25.197975 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:25.198537 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:25.204917 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:25.205422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:25.206454 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:25.207151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:25.207599 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:25.208043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:25.563741 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:25.572097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8bcfcbbf-8ba2-499a-9bf7-231c4f57bf7d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1322 microversion: 2.1 time: 0.378653 Sep 01 17:40:25.572749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 418/847] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:25 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:25.924022 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-e1e1da85-d1c0-4349-9ce2-468ad77c6c8d req-bc24d626-1050-449d-9338-906743717031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ae6b12-3aa6-4faf-8ad2-bd4ec365099a", "tag": "19c2b4c7-2546-43f4-9584-01f6352632e4"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:25.935011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-e1e1da85-d1c0-4349-9ce2-468ad77c6c8d req-bc24d626-1050-449d-9338-906743717031 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:25.935493 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-e1e1da85-d1c0-4349-9ce2-468ad77c6c8d req-bc24d626-1050-449d-9338-906743717031 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:25.935925 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-e1e1da85-d1c0-4349-9ce2-468ad77c6c8d req-bc24d626-1050-449d-9338-906743717031 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:25.955028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-e1e1da85-d1c0-4349-9ce2-468ad77c6c8d req-bc24d626-1050-449d-9338-906743717031 service nova] Creating event network-changed:19c2b4c7-2546-43f4-9584-01f6352632e4 for instance 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a on hv-cinder-85221 Sep 01 17:40:25.963975 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-e1e1da85-d1c0-4349-9ce2-468ad77c6c8d req-bc24d626-1050-449d-9338-906743717031 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043700 Sep 01 17:40:25.964610 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 430/848] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:26.592208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:26.592951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:26.599929 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:26.600476 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:26.600970 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:26.601744 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:26.602259 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:26.602677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:26.736291 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:26.744716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-06b028a6-ba30-44f1-a457-03f3bc9e551c tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1322 microversion: 2.1 time: 0.156299 Sep 01 17:40:26.745282 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 419/849] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:26 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:27.765061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:27.765786 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:27.772413 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:27.772888 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:27.773333 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:27.774074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:27.775533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:27.776324 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:27.905157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:27.912733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e5c75fe7-1d42-45d5-ad87-1bf5a44d0269 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1322 microversion: 2.1 time: 0.151980 Sep 01 17:40:27.913288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 431/850] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:27 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:27.996669 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-278f282b-d972-47c1-9183-cdb7ade2971a req-f8051bdc-c74d-4874-b799-215ad7677705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84b9974e-1129-41ba-8a64-383db67ca891", "tag": "c41b96e8-8833-4515-b4c4-0fea0ffe7475"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:28.006845 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-278f282b-d972-47c1-9183-cdb7ade2971a req-f8051bdc-c74d-4874-b799-215ad7677705 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.007311 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-278f282b-d972-47c1-9183-cdb7ade2971a req-f8051bdc-c74d-4874-b799-215ad7677705 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.007729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-278f282b-d972-47c1-9183-cdb7ade2971a req-f8051bdc-c74d-4874-b799-215ad7677705 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.018412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-278f282b-d972-47c1-9183-cdb7ade2971a req-f8051bdc-c74d-4874-b799-215ad7677705 service nova] Creating event network-changed:c41b96e8-8833-4515-b4c4-0fea0ffe7475 for instance 84b9974e-1129-41ba-8a64-383db67ca891 on hv-cinder-85221 Sep 01 17:40:28.023156 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-278f282b-d972-47c1-9183-cdb7ade2971a req-f8051bdc-c74d-4874-b799-215ad7677705 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030106 Sep 01 17:40:28.023705 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 420/851] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:28.932851 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:28.933497 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:28.940448 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.940921 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.941407 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:28.942083 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:28.942525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:28.942934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:29.076773 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:29.084967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9bd29ae4-4d29-4aba-96d0-dae449ebc889 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1322 microversion: 2.1 time: 0.155929 Sep 01 17:40:29.087153 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 432/852] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:28 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:30.108121 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:30.108818 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:30.114927 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.115400 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.115849 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:30.116528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:30.117020 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:30.117491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:30.243777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:30.251423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-53ad0d34-70ea-4c1c-9b07-b579e20354da tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1322 microversion: 2.1 time: 0.147954 Sep 01 17:40:30.251996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 421/853] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:30 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:31.272282 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:31.272894 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:31.282371 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:31.288471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:31.288954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:31.289406 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:31.290106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:31.290629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:31.291044 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:31.419626 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:31.423071 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:31.428265 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-05a3476e-5751-40d4-aae7-992fc5b9ac98 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1322 microversion: 2.1 time: 0.160448 Sep 01 17:40:31.428835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 433/854] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:31 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:32.450053 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:32.450679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:32.452583 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:32.453393 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=6 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:32.459971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.460441 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.460868 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.461572 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.462016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.462426 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.592853 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:32.601060 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-890e9c69-84b4-4696-88e5-d16866d45ad3 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1322 microversion: 2.1 time: 0.155177 Sep 01 17:40:32.601650 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 422/855] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:32 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:32.930425 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-2b937f63-ee58-48f4-9e91-c604c7a87e56 req-68e5ac08-2060-4c04-b1ae-d049ea4c7dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ae6b12-3aa6-4faf-8ad2-bd4ec365099a", "name": "network-vif-plugged", "status": "completed", "tag": "19c2b4c7-2546-43f4-9584-01f6352632e4"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:32.942412 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-2b937f63-ee58-48f4-9e91-c604c7a87e56 req-68e5ac08-2060-4c04-b1ae-d049ea4c7dad service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:32.942901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-2b937f63-ee58-48f4-9e91-c604c7a87e56 req-68e5ac08-2060-4c04-b1ae-d049ea4c7dad service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:32.943528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-2b937f63-ee58-48f4-9e91-c604c7a87e56 req-68e5ac08-2060-4c04-b1ae-d049ea4c7dad service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:32.954931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-2b937f63-ee58-48f4-9e91-c604c7a87e56 req-68e5ac08-2060-4c04-b1ae-d049ea4c7dad service nova] Creating event network-vif-plugged:19c2b4c7-2546-43f4-9584-01f6352632e4 for instance 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a on hv-cinder-85221 Sep 01 17:40:32.960871 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-2b937f63-ee58-48f4-9e91-c604c7a87e56 req-68e5ac08-2060-4c04-b1ae-d049ea4c7dad service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034349 Sep 01 17:40:32.961745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 434/856] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:33.621648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:33.622252 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:33.628584 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:33.629049 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:33.629509 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.630183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:33.630626 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:33.631037 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:33.635032 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:33.772410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:33.779989 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ce53e54b-e8cb-42dc-a868-054cab383906 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1322 microversion: 2.1 time: 0.162399 Sep 01 17:40:33.780547 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 423/857] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:33 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:34.801822 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:34.802520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:34.809398 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:34.809885 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:34.810321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:34.811061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:34.811518 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:34.811937 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:34.947409 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:34.955883 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-502d9768-f5da-4c87-afb8-23d6c28d3c66 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1322 microversion: 2.1 time: 0.158907 Sep 01 17:40:34.956435 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 435/858] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:34 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:35.976065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:35.976708 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:35.983241 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.983719 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.984153 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:35.984834 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:35.985284 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:35.985729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:36.093087 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-31931acb-4ecc-4088-8754-a76262932e45 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:36.094050 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-31931acb-4ecc-4088-8754-a76262932e45 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:36.109638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-31931acb-4ecc-4088-8754-a76262932e45 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:36.110157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-31931acb-4ecc-4088-8754-a76262932e45 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:36.110595 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-31931acb-4ecc-4088-8754-a76262932e45 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:36.111869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-31931acb-4ecc-4088-8754-a76262932e45 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:36.112323 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-31931acb-4ecc-4088-8754-a76262932e45 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:36.112743 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-31931acb-4ecc-4088-8754-a76262932e45 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:36.137666 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:36.147242 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7d6ee3a8-b2e9-4cb1-935c-d74f338b4c4b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1510 microversion: 2.1 time: 0.174976 Sep 01 17:40:36.147821 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 424/859] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:35 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:36.152166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-31931acb-4ecc-4088-8754-a76262932e45 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/ips" status: 200 len: 151 microversion: 2.20 time: 0.062917 Sep 01 17:40:36.152733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 436/860] 10.222.0.102 () {60 vars in 1294 bytes} [Thu Sep 1 17:40:36 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/ips => generated 151 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:40:42.347423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:42.348074 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:42.354962 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.355481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.355907 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.356614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.357059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.357526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.383321 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lazy-loading 'flavor' on Instance uuid 33c4bba1-dbe2-4433-837f-4da4534901f8 {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:40:42.592499 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ce9ab4bb-7d63-41f8-9325-7b223f4aee8d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/action" status: 202 len: 0 microversion: 2.20 time: 0.249667 Sep 01 17:40:42.593067 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 425/861] 10.222.0.102 () {62 vars in 1324 bytes} [Thu Sep 1 17:40:42 2022] POST /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:40:42.601862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:42.602417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:42.604573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=39 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:42.610264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.610804 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.611240 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.611934 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:42.612387 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:42.612807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:42.775706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:42.783887 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:42.785341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:42.786491 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e678cabd-8500-4ab3-9ebc-462a3fc3f213 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.188922 Sep 01 17:40:42.787043 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 437/862] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:42 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:43.814277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:43.815209 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:43.822054 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.822529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.822954 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.823967 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:43.824404 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:43.824872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:43.966967 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:43.978266 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:43.979732 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:43.980888 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c1f56f67-a356-4f9c-bf80-d798d447cc6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.174358 Sep 01 17:40:43.981477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 426/863] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:43 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:45.004297 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:45.004993 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:45.011762 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:45.012272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:45.012712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:45.013463 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:45.013920 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:45.014347 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:45.143849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:45.152202 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:45.153694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:45.154907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b4bd78d4-fbc3-4fc3-b751-48d434ecc702 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.155286 Sep 01 17:40:45.155472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 438/864] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:44 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:46.180095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:46.180929 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:46.183152 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:46.188561 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.189051 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.189511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.190196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:46.190645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:46.191065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:46.336007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:46.344132 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:46.346120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:46.347253 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3d8cfbfc-517c-48ce-9d58-369592875b15 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.172452 Sep 01 17:40:46.347797 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 427/865] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:46 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:47.370596 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:47.371249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:47.377778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:47.378285 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:47.378712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:47.379477 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:47.379923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:47.380427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:47.517606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:47.525847 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:47.527293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:47.528449 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1866760c-54aa-4e73-aa96-2ec75167e2cf tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.161832 Sep 01 17:40:47.529019 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 439/866] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:47 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:48.553564 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:48.554255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:48.560425 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:48.560905 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:48.561368 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:48.562066 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:48.562522 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:48.562999 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:48.718724 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:48.728861 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:48.730302 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:48.731438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-584e5ecf-612d-4023-8548-789dcf486c74 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.182620 Sep 01 17:40:48.731985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 428/867] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:48 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:48.918866 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2095147183", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-580347756", "security_groups": [{"name": "tempest-secgroup-smoke-412480106"}], "block_device_mapping_v2": [{"uuid": "38e4989e-0d89-4f2e-bbe6-3021b0fa8efc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41816984-3dfb-46d4-ba93-ea737106ee4f"}]}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:49.035064 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] validate_networks() for [('41816984-3dfb-46d4-ba93-ea737106ee4f', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:40:49.483605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:40:49.484035 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:40:49.484507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:40:49.485537 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:40:49.485959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:40:49.495416 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.495914 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.496354 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.497202 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.497845 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.498559 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.520613 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Getting quotas for project 2cc300abf09e4bb3857336df552286e2. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:40:49.526200 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Getting quotas for user 8f59383e2f6c4da8b683d718f62d25fb and project 2cc300abf09e4bb3857336df552286e2. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:40:49.591756 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:40:49.593962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38e4989e-0d89-4f2e-bbe6-3021b0fa8efc',volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:40:49.732016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d9fb0884-5d3f-4e04-9a6d-4fb0cdad5c24 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.817104 Sep 01 17:40:49.732867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 440/868] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:40:48 2022] POST /compute/v2.1/servers => generated 407 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:40:49.744775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c4fc1b52-bb3f-440d-9c2f-df203340067a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:49.745422 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c4fc1b52-bb3f-440d-9c2f-df203340067a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:49.757269 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:49.757931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:49.764995 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.765107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.765499 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.766238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:49.766692 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:49.767112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:49.803701 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c4fc1b52-bb3f-440d-9c2f-df203340067a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:49.815603 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c4fc1b52-bb3f-440d-9c2f-df203340067a tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1097 microversion: 2.1 time: 0.071995 Sep 01 17:40:49.815923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 429/869] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:49 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1097 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:49.920660 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:49.931407 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:49.933238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:49.934716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8f717fe0-3cf8-4570-8488-728986378deb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.181297 Sep 01 17:40:49.935277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 441/870] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:49 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:50.839795 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:50.840796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:50.849340 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:50.849858 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:50.850293 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:50.851039 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:50.851494 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:50.851918 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:50.928717 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:50.940787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5208d403-9939-49ae-bc2f-7ad652730125 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1195 microversion: 2.1 time: 0.107457 Sep 01 17:40:50.941686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 430/871] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:50 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1195 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:50.959287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:50.960024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:50.967286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:50.967784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:50.968220 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:50.969712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:50.970181 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:50.970754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:51.127500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:51.143513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:51.146814 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:51.149118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b7d9f412-5a11-425d-8e41-d85157876a43 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.194093 Sep 01 17:40:51.150524 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 442/872] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:50 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:51.971565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:51.972232 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:51.978940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:51.979433 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:51.980186 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:51.980899 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:51.981382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:51.981813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:52.177106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:52.177936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:52.185608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:52.186359 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:52.187037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:52.188905 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:52.189462 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:52.191150 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:52.196434 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:52.205221 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4ab752be-2a29-4aae-928d-6934ac7cc3ef tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1280 microversion: 2.1 time: 0.237840 Sep 01 17:40:52.205823 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 431/873] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:51 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1280 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:52.351785 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:52.355914 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:52.357382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:52.358557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ee5a4787-98ca-4e8e-b833-5c095969631a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.185421 Sep 01 17:40:52.359614 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 443/874] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:52 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:52.799069 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-a70b279a-b5e6-461d-8243-25b045fddb23 req-ea3c8212-2b2d-4ec2-8a83-a3aade87a030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1df560e-95ad-4efd-9e8e-9252fe66397b", "tag": "28779c04-5b79-4148-9856-ace8639fe9d0"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:40:52.814619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a70b279a-b5e6-461d-8243-25b045fddb23 req-ea3c8212-2b2d-4ec2-8a83-a3aade87a030 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:52.815116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a70b279a-b5e6-461d-8243-25b045fddb23 req-ea3c8212-2b2d-4ec2-8a83-a3aade87a030 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:52.815749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-a70b279a-b5e6-461d-8243-25b045fddb23 req-ea3c8212-2b2d-4ec2-8a83-a3aade87a030 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:52.830131 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-a70b279a-b5e6-461d-8243-25b045fddb23 req-ea3c8212-2b2d-4ec2-8a83-a3aade87a030 service nova] Creating event network-changed:28779c04-5b79-4148-9856-ace8639fe9d0 for instance d1df560e-95ad-4efd-9e8e-9252fe66397b on hv-cinder-85221 Sep 01 17:40:52.835012 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-a70b279a-b5e6-461d-8243-25b045fddb23 req-ea3c8212-2b2d-4ec2-8a83-a3aade87a030 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040111 Sep 01 17:40:52.835618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 432/875] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:40:53.227148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:53.227759 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:53.235092 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.235637 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.236074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.236967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.237452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.237877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.383687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:53.384378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:53.393068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.393612 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.394046 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.394764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:53.395198 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:53.395619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:53.647921 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:53.655707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:53.658038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-24b2299f-0f5d-4eb9-8efd-a867f7bfc2a5 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.435254 Sep 01 17:40:53.658694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 444/876] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:53 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:53.665097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:53.666850 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:53.668481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-46329b5b-67f4-4593-bf2e-fc689f48ce7d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.289528 Sep 01 17:40:53.670852 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 433/877] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:53 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:54.680155 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:54.680761 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:54.687188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:54.687669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:54.688102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:54.688795 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:54.689260 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:54.689707 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:54.693292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:54.693952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:54.704764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:54.705576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:54.706280 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:54.707419 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:54.708181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:54.708884 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:54.833299 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:54.842455 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c29baf66-86d4-4020-b09c-ea21ecfc7814 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.166018 Sep 01 17:40:54.843008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 445/878] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:54 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:54.847268 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:54.859429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:54.860804 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:54.862003 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-88994b9c-37bb-4091-aacf-2b05eb80f2c4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.172550 Sep 01 17:40:54.862585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 434/879] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:54 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:55.866491 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:55.867102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:55.873929 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:55.874410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:55.874877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:55.875574 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:55.876024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:55.876443 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:55.884176 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:55.885372 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:55.892021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:55.892440 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:55.892867 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:55.893790 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:55.894383 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:55.894813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:56.014979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:56.023096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2af82c16-675d-4815-a43b-fee49fe7dc9c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.160447 Sep 01 17:40:56.023770 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 446/880] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:55 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:56.123653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:56.131748 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:56.133186 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:56.134408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f9b7cfbf-e517-4026-8fc8-3bcbbe62f74a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.254320 Sep 01 17:40:56.134957 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 435/881] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:55 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:57.044121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:57.044726 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:57.051693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.052172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.052602 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.053282 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.053753 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.054170 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.157659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:57.158326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:57.165148 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.165717 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.166182 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.166924 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:57.167399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:57.167843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:57.190294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:57.198794 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-08fcd5b4-5b73-4888-86d7-d111107f9d0b tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.158610 Sep 01 17:40:57.199363 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 447/882] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:57 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:40:57.298421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:57.306498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:57.307926 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:57.309063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-79e061d2-d084-4548-8128-c8859bebca26 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.155727 Sep 01 17:40:57.309639 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 436/883] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:57 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:40:58.219405 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:58.220011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:58.226706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:58.227196 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:58.227632 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:58.228332 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:58.228787 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:58.229211 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:58.333729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:58.334334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:58.340885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:58.341391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:58.341815 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:58.342506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:58.342949 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:58.343359 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:58.369052 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:58.377570 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1369b50d-41e8-4469-ad88-f4cb8c332e56 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.161989 Sep 01 17:40:58.378143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 448/884] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:58 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:58.469626 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:58.477749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:58.479176 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:58.480323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-afb43882-8631-4768-8e32-d7f8926fa8ec tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.151247 Sep 01 17:40:58.480878 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 437/885] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:58 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:40:59.398565 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:59.399153 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:59.406861 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:59.407948 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:59.408455 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:59.409178 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:59.409673 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:59.410101 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:59.504072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:40:59.504682 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:40:59.508276 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:59.511678 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:59.512164 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:59.512601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:59.513299 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:40:59.513787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:40:59.514212 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:40:59.534865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:40:59.542321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:59.550101 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1fd5f40d-1a30-477b-b857-9c3123d420ad tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.155783 Sep 01 17:40:59.550669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 449/886] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:40:59 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:40:59.649673 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:59.658062 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:59.659556 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:40:59.660783 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b1ca516c-d57a-4900-93da-18f0e22bd77f tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.161053 Sep 01 17:40:59.661399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 438/887] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:40:59 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:41:00.571325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:00.571936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:00.578741 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:00.579221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:00.579653 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:00.580336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:00.580791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:00.581210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:00.684689 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:00.685292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:00.687364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:00.693262 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:00.693774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:00.694208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:00.694891 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:00.695342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:00.695761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:00.715140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:00.715328 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:00.723628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2f509605-b1e5-410b-b063-f6c327647f95 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.156224 Sep 01 17:41:00.724182 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 450/888] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:00 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:00.829195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:00.837252 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:00.838708 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:00.839855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-68990620-2907-4c4b-983f-8f35b721c246 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.159563 Sep 01 17:41:00.840405 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 439/889] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:00 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:41:01.744778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:01.745923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:01.755803 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:01.756348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:01.756821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:01.759439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:01.759946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:01.762162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:01.867522 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:01.868346 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:01.878689 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:01.879171 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:01.880092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:01.883018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:01.884164 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:01.884588 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:01.947746 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:01.959180 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-46f7db78-c43b-4e3e-92b8-56237caa8fe7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.218035 Sep 01 17:41:01.960049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 451/890] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:01 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:02.065838 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:02.079309 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:02.080799 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:02.082024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-734c38d1-cd33-4418-925a-1b1bfc1f2a23 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.218628 Sep 01 17:41:02.082588 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 440/891] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:01 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:02.988458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:02.989074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:02.995620 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:02.996105 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:02.996538 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:02.997227 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:02.997708 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:02.998131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:03.000743 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=99 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:03.104393 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:03.105010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:03.111541 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:03.112028 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:03.112981 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:03.113191 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:03.113656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:03.114100 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:03.143010 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:03.150758 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-82b8e53f-29d5-455d-97c6-03d90255a5ea tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.166176 Sep 01 17:41:03.151325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 452/892] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:02 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:03.248246 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:03.256477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:03.257913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:03.259055 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b3acd9e4-07b0-4987-a7ee-fdee73d1eb57 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.158885 Sep 01 17:41:03.259607 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 441/893] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:03 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:04.175630 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:04.176303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:04.182793 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:04.183288 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:04.183745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:04.184427 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:04.184874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:04.185292 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:04.282784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:04.283397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:04.290033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:04.290519 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:04.290955 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:04.291654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:04.292129 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:04.292550 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:04.336734 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:04.352447 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-18c31c1e-0b26-4b9a-9446-71bb6f5a5790 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.184475 Sep 01 17:41:04.353093 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 453/894] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:04 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:04.431429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:04.439933 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:04.441365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:04.442509 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fc9275e3-485a-4061-acc6-ce1159ca1c5d tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.163829 Sep 01 17:41:04.443067 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 442/895] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:04 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:41:05.376732 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:05.377295 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:05.383817 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:05.384296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:05.384737 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:05.385458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:05.385935 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:05.386355 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:05.471681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:05.472315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:05.478757 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:05.479235 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:05.479670 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:05.480355 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:05.480885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:05.481324 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:05.519889 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:05.527734 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9c1a827e-ea4a-4829-9575-523730c86a61 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.155372 Sep 01 17:41:05.528328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 454/896] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:05 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:05.613751 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:05.625005 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:05.626489 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:05.627717 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7abf5505-f79b-44f9-830b-be1cb3d45c96 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.160497 Sep 01 17:41:05.628254 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 443/897] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:05 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:41:06.550049 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:06.550910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:06.557828 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:06.557828 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:06.558198 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:06.558893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:06.559346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:06.559769 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:06.655220 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:06.655991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:06.665023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:06.665654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:06.666163 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:06.667149 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:06.667526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:06.668019 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:06.727480 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:06.736136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9cd134f0-3dfe-4cf5-af21-f6ffcbc31817 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.190508 Sep 01 17:41:06.736705 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 455/898] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:06 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:06.830181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:06.838872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:06.840315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:06.841521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ee8f52d1-a9d8-40ee-a73f-df95f4a9c756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1749 microversion: 2.20 time: 0.192556 Sep 01 17:41:06.842087 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 444/899] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:06 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1749 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:41:07.756380 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:07.756977 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:07.763515 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:07.764000 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:07.764433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:07.765727 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:07.766183 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:07.766608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:07.865592 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:07.866466 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:07.872963 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:07.873477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:07.873951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:07.875170 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:07.875622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:07.876038 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:07.904891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:07.914600 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a233e264-9265-45ed-a7c7-5d351db7dd47 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.161385 Sep 01 17:41:07.914600 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 456/900] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:07 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:08.159068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:08.167517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:08.169077 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:08.170271 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-eebc43cc-d9d5-49b3-bf04-6eeef29abbe3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1749 microversion: 2.20 time: 0.308624 Sep 01 17:41:08.170814 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 445/901] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:07 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1749 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:41:08.935686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:08.936339 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:08.942782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:08.943294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:08.943766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:08.944470 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:08.944930 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:08.945378 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:09.081875 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:09.090277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fd9df925-7bc1-4f1d-8072-347c8cfbe1cc tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.158492 Sep 01 17:41:09.090902 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 457/902] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:08 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:09.194239 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:09.194864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:09.202755 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:09.203251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:09.203724 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:09.204618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:09.204910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:09.205348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:09.308019 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-f293fe31-4c3c-4abe-a02e-05f5d617d4d1 req-505858e9-12dc-4e63-aee1-ce439e83bdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1df560e-95ad-4efd-9e8e-9252fe66397b", "name": "network-vif-plugged", "status": "completed", "tag": "28779c04-5b79-4148-9856-ace8639fe9d0"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:09.325841 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f293fe31-4c3c-4abe-a02e-05f5d617d4d1 req-505858e9-12dc-4e63-aee1-ce439e83bdd8 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:09.326279 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f293fe31-4c3c-4abe-a02e-05f5d617d4d1 req-505858e9-12dc-4e63-aee1-ce439e83bdd8 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:09.327704 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-f293fe31-4c3c-4abe-a02e-05f5d617d4d1 req-505858e9-12dc-4e63-aee1-ce439e83bdd8 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:09.346915 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-f293fe31-4c3c-4abe-a02e-05f5d617d4d1 req-505858e9-12dc-4e63-aee1-ce439e83bdd8 service nova] Creating event network-vif-plugged:28779c04-5b79-4148-9856-ace8639fe9d0 for instance d1df560e-95ad-4efd-9e8e-9252fe66397b on hv-cinder-85221 Sep 01 17:41:09.352030 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-f293fe31-4c3c-4abe-a02e-05f5d617d4d1 req-505858e9-12dc-4e63-aee1-ce439e83bdd8 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047618 Sep 01 17:41:09.352807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 458/903] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:41:09.358014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:09.367457 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:09.368922 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:09.370103 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9070c61b-e904-43a5-b2a6-207c56bc253b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1749 microversion: 2.20 time: 0.180002 Sep 01 17:41:09.370650 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 446/904] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:09 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:10.114938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:10.115641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:10.121898 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:10.122372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:10.122807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:10.123479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:10.124564 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:10.124976 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:10.275123 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:10.283633 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ab5e8d7f-e561-4842-9e2e-32cfaf2549c3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.175561 Sep 01 17:41:10.284223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 459/905] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:10 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:10.393723 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:10.394244 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:10.400842 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:10.401336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:10.401768 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:10.402447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:10.402888 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:10.403298 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:10.560106 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:10.568240 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:10.569658 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:10.570790 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-661aebcc-4edf-41d6-94f5-5e0382432a50 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1749 microversion: 2.20 time: 0.181173 Sep 01 17:41:10.571329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 447/906] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:10 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:11.305212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:11.305868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:11.312851 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:11.313460 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:11.313876 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:11.314590 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:11.315044 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:11.315467 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:11.374181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-2f4a7960-058f-4a6a-8d0d-9c072258c2e3 req-6af4f995-aa83-4e90-9c55-c3dade06a823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c4bba1-dbe2-4433-837f-4da4534901f8", "name": "network-vif-plugged", "status": "completed", "tag": "568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:11.384388 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-2f4a7960-058f-4a6a-8d0d-9c072258c2e3 req-6af4f995-aa83-4e90-9c55-c3dade06a823 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:11.385183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-2f4a7960-058f-4a6a-8d0d-9c072258c2e3 req-6af4f995-aa83-4e90-9c55-c3dade06a823 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:11.385331 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-2f4a7960-058f-4a6a-8d0d-9c072258c2e3 req-6af4f995-aa83-4e90-9c55-c3dade06a823 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:11.399928 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-2f4a7960-058f-4a6a-8d0d-9c072258c2e3 req-6af4f995-aa83-4e90-9c55-c3dade06a823 service nova] Creating event network-vif-plugged:568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e for instance 33c4bba1-dbe2-4433-837f-4da4534901f8 on hv-cinder-85221 Sep 01 17:41:11.406235 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-2f4a7960-058f-4a6a-8d0d-9c072258c2e3 req-6af4f995-aa83-4e90-9c55-c3dade06a823 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036715 Sep 01 17:41:11.406823 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 448/907] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:41:11.567420 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c0a553b5-97e3-471b-9448-a0984bea65fd tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dee73889-01ae-49a9-be80-d9238c092fe9", "device": "/dev/sdb"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:11.570996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c0a553b5-97e3-471b-9448-a0984bea65fd tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:11.578824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0a553b5-97e3-471b-9448-a0984bea65fd tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:11.579386 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0a553b5-97e3-471b-9448-a0984bea65fd tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:11.580145 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0a553b5-97e3-471b-9448-a0984bea65fd tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:11.581065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0a553b5-97e3-471b-9448-a0984bea65fd tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:11.581540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0a553b5-97e3-471b-9448-a0984bea65fd tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:11.582138 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c0a553b5-97e3-471b-9448-a0984bea65fd tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:11.727642 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:11.736066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c1400f7f-843b-4b85-88ad-85f750793c16 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1268 microversion: 2.1 time: 0.434772 Sep 01 17:41:11.736632 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 460/908] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:11 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1268 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:11.741050 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:11.741733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:11.747346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:11.747818 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:11.748255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:11.749606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:11.750059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:11.750474 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:11.888720 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:11.898980 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:11.902065 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:11.903478 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d65ff4c4-355d-4e97-a4bd-48d497016075 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1749 microversion: 2.20 time: 0.165720 Sep 01 17:41:11.904297 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 461/909] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:11 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:12.613947 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c0a553b5-97e3-471b-9448-a0984bea65fd tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "POST /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.050811 Sep 01 17:41:12.614716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 449/910] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:41:11 2022] POST /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a/os-volume_attachments => generated 194 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:41:12.757807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:12.758442 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:12.760421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:12.766419 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:12.766826 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:12.767258 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:12.767957 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:12.768410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:12.768831 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:12.902524 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:12.910562 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-58193ea1-fa84-4608-8840-06304e445234 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1455 microversion: 2.1 time: 0.156592 Sep 01 17:41:12.911130 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 462/911] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:12 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:41:12.927272 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:12.928102 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:12.930233 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:12.930844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:12.934671 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:12.935152 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:12.935576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:12.936782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:12.937094 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:12.937222 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:12.937608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:12.937733 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:12.938068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:12.938784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:12.939237 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:12.939656 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:13.070293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:13.070981 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:13.079023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5e2f2dc7-2aee-4818-8f01-adf0611061e4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1455 microversion: 2.1 time: 0.152469 Sep 01 17:41:13.079598 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 463/912] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:41:12 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:41:13.079875 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:13.081529 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:13.082700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-09d302c5-6ff5-4388-ba14-c4127ba9694e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1749 microversion: 2.20 time: 0.160206 Sep 01 17:41:13.083241 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 450/913] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:12 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:14.105558 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:14.106159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:14.112595 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:14.113081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:14.113543 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:14.114243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:14.114693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:14.115115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:14.253821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:14.262144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:14.263495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:14.265256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-cb2e8a5a-d4d2-4d75-aa9c-9747be623756 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1749 microversion: 2.20 time: 0.163734 Sep 01 17:41:14.265824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 464/914] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:14 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:14.747311 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-51667ddd-eb6b-4591-b79a-20744dd57a45 req-827dd3ce-4ab4-4e4b-895e-e17495ba3c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1df560e-95ad-4efd-9e8e-9252fe66397b", "tag": "28779c04-5b79-4148-9856-ace8639fe9d0"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:14.757414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-51667ddd-eb6b-4591-b79a-20744dd57a45 req-827dd3ce-4ab4-4e4b-895e-e17495ba3c83 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:14.757895 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-51667ddd-eb6b-4591-b79a-20744dd57a45 req-827dd3ce-4ab4-4e4b-895e-e17495ba3c83 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:14.758646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-51667ddd-eb6b-4591-b79a-20744dd57a45 req-827dd3ce-4ab4-4e4b-895e-e17495ba3c83 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:14.772022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-51667ddd-eb6b-4591-b79a-20744dd57a45 req-827dd3ce-4ab4-4e4b-895e-e17495ba3c83 service nova] Creating event network-changed:28779c04-5b79-4148-9856-ace8639fe9d0 for instance d1df560e-95ad-4efd-9e8e-9252fe66397b on hv-cinder-85221 Sep 01 17:41:14.776833 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-51667ddd-eb6b-4591-b79a-20744dd57a45 req-827dd3ce-4ab4-4e4b-895e-e17495ba3c83 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033145 Sep 01 17:41:14.777445 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 451/915] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:41:15.289140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:15.289944 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:15.296595 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:15.297083 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:15.297587 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:15.298283 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:15.298732 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:15.299154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:15.435608 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:15.444610 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:15.446541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:15.447840 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5f2814b3-1c1b-4316-9b51-721a797c5ba9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1749 microversion: 2.20 time: 0.163638 Sep 01 17:41:15.448918 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 465/916] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:15 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:16.480561 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:16.481264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:16.486359 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=52 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:16.491870 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:16.492379 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:16.492845 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:16.493571 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:16.494214 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:16.494644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:16.643334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:16.651797 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:16.653521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:16.655302 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d4fd0f59-8b9c-4a7e-b4f7-ea02a368e664 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.187129 Sep 01 17:41:16.655852 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 452/917] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:16 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:17.678661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:17.679399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:17.686458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:17.686942 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:17.687375 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:17.688066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:17.688519 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:17.688943 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:17.855051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:17.864815 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:17.866293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:17.867429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6db56429-6a45-4533-a01c-2ba9ab6f18f3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.192689 Sep 01 17:41:17.881484 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 466/918] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:17 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:19.044720 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:19.046705 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:19.056539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:19.057505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:19.058289 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:19.059217 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:19.061772 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:19.062041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:19.212844 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:19.221907 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:19.223367 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:19.224546 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-391ebba3-041c-4309-b316-cece54ecb151 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.337916 Sep 01 17:41:19.225100 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 453/919] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:18 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:20.248617 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:20.249239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:20.256151 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:20.256864 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:20.257487 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:20.258180 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:20.258629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:20.259039 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:20.434819 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:20.444593 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:20.446600 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:20.447767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-600f0b26-88d8-4ca6-9a12-e4dcb64480b3 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.203620 Sep 01 17:41:20.448317 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 467/920] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:20 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:21.475129 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:21.476630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:21.484338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:21.485177 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:21.485820 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:21.486875 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:21.487391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:21.487968 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:21.630188 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:21.640508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:21.641986 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:21.643740 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-bcbc86ba-d1e1-4ea5-8d42-9cfe7c8bebb4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.173600 Sep 01 17:41:21.644484 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 454/921] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:21 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:41:22.667842 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:22.669107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:22.676485 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:22.677174 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:22.677954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:22.678660 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:22.679115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:22.679688 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:22.859001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:22.867985 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:22.869458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:22.871138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a1f35a7f-94b8-4630-94cc-1d970017a096 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.207403 Sep 01 17:41:22.886313 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 468/922] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:22 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:23.897161 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:23.897920 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:23.908349 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:23.910407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:23.911312 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:23.912802 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:23.914129 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:23.915869 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:24.067941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:24.077636 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:24.079322 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:24.080473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ce280248-d1df-4e48-83b3-8a567f05ce69 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.188568 Sep 01 17:41:24.081017 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 455/923] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:23 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:25.111197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:25.112500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:25.119617 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:25.120193 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:25.120844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:25.121809 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:25.123287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:25.124239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:25.142967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=100 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:25.287702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:25.297876 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:25.300311 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:25.301674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9005e22b-62c8-4e73-8137-b32554fbc5ac tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.195934 Sep 01 17:41:25.303111 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 469/924] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:25 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:26.325211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:26.325852 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:26.332576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:26.333053 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:26.333537 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:26.334228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:26.334674 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:26.335091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:26.339023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:26.471761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:26.480528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:26.482637 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:26.483784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f10d2db3-4ded-4933-ae12-b2ae30018cd0 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.162822 Sep 01 17:41:26.484330 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 456/925] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:26 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:27.506298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:27.506926 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:27.513352 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:27.513833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:27.514265 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:27.514945 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:27.515396 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:27.515813 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:27.643871 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:27.652814 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:27.654327 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:27.655483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-09b9f288-8f42-494f-a0f1-2f5b3ba93ce9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1744 microversion: 2.20 time: 0.153179 Sep 01 17:41:27.656085 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 470/926] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:27 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:28.679345 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:28.680040 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:28.687357 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:28.688726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:28.689229 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:28.690303 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:28.690770 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:28.691196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:28.926046 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:28.934010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:28.935478 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:28.936627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-464bd0b2-fc4c-476a-8e4b-a866eef76a56 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1726 microversion: 2.20 time: 0.261220 Sep 01 17:41:28.937176 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 457/927] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:28 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1726 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:29.960095 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:29.960688 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:29.967443 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:29.967915 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:29.968337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:29.969009 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:29.969490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:29.969932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:30.101174 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:30.109845 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:30.111267 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:30.112400 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-acaa7a70-5c8f-4345-b1d7-e43b784f3637 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1726 microversion: 2.20 time: 0.156278 Sep 01 17:41:30.112941 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 471/928] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:29 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:31.135452 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:31.136013 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:31.142311 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:31.142778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:31.143199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:31.143869 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:31.144310 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:31.144722 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:31.285630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:31.293646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:31.295556 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:31.296690 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ef28a6a0-77f3-44a5-ac55-350e85660275 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1726 microversion: 2.20 time: 0.165261 Sep 01 17:41:31.297234 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 458/929] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:31 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:32.319787 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:32.320655 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:32.328278 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:32.328791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:32.329241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:32.329990 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:32.330458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:32.330890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:32.459417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:32.467490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:32.468906 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:32.470067 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ec18493e-80d2-4eac-acef-10782dbeb461 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1726 microversion: 2.20 time: 0.154269 Sep 01 17:41:32.470617 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 472/930] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:32 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:32.883555 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-fcb6a306-d88d-4190-97f2-9c407fb099cb req-443ad0bd-1463-4536-a7c6-bf86b1e7e435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c4bba1-dbe2-4433-837f-4da4534901f8", "name": "network-vif-unplugged", "status": "completed", "tag": "568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:32.894781 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fcb6a306-d88d-4190-97f2-9c407fb099cb req-443ad0bd-1463-4536-a7c6-bf86b1e7e435 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:32.895232 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fcb6a306-d88d-4190-97f2-9c407fb099cb req-443ad0bd-1463-4536-a7c6-bf86b1e7e435 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:32.895653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fcb6a306-d88d-4190-97f2-9c407fb099cb req-443ad0bd-1463-4536-a7c6-bf86b1e7e435 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:32.907359 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-fcb6a306-d88d-4190-97f2-9c407fb099cb req-443ad0bd-1463-4536-a7c6-bf86b1e7e435 service nova] Creating event network-vif-unplugged:568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e for instance 33c4bba1-dbe2-4433-837f-4da4534901f8 on hv-cinder-85221 Sep 01 17:41:32.912201 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-fcb6a306-d88d-4190-97f2-9c407fb099cb req-443ad0bd-1463-4536-a7c6-bf86b1e7e435 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032365 Sep 01 17:41:32.912775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 459/931] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:41:33.492001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:33.492616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:33.499979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:33.500539 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:33.501048 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:33.501773 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:33.502272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:33.502787 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:33.634476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:33.642604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:33.644062 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:33.645199 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d45e142f-e23b-413e-b340-30d04288ef0b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1726 microversion: 2.20 time: 0.157169 Sep 01 17:41:33.645775 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 473/932] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:33 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:34.668148 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:34.668913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:34.675038 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:34.675521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:34.675953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:34.676639 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:34.677094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:34.677542 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:34.804979 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:34.813787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:34.815239 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:34.817398 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4f7fa9d9-2518-410c-8c37-60d1e96b4592 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1726 microversion: 2.20 time: 0.153750 Sep 01 17:41:34.818221 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 460/933] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:34 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:35.841632 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:35.842244 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:35.849433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:35.849433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:35.849677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:35.850370 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:35.850747 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:35.851172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:35.982503 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:35.990507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:35.991942 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:35.993086 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-560217d7-fda6-4963-8d5e-0e96969d1a51 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1726 microversion: 2.20 time: 0.156125 Sep 01 17:41:35.993680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 474/934] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:35 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:37.016097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:37.016691 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:37.023097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:37.023569 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:37.023996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:37.024669 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:37.025109 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:37.025552 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:37.157356 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:37.165445 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:37.166856 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:37.167989 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-defe98a2-9b9a-45db-a8e0-a2bc51004ffe tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1729 microversion: 2.20 time: 0.155889 Sep 01 17:41:37.168537 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 461/935] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:37 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:37.189717 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b481ecc5-d62b-49bc-9a27-330b8330aeb6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f229a9a1-5e7d-4a54-85f3-3bdd58b63a14"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:37.192071 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b481ecc5-d62b-49bc-9a27-330b8330aeb6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:37.198831 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b481ecc5-d62b-49bc-9a27-330b8330aeb6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:37.199345 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b481ecc5-d62b-49bc-9a27-330b8330aeb6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:37.200273 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b481ecc5-d62b-49bc-9a27-330b8330aeb6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:37.200962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b481ecc5-d62b-49bc-9a27-330b8330aeb6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:37.201445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b481ecc5-d62b-49bc-9a27-330b8330aeb6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:37.201872 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b481ecc5-d62b-49bc-9a27-330b8330aeb6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:37.467932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b481ecc5-d62b-49bc-9a27-330b8330aeb6 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282154 Sep 01 17:41:37.468537 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 475/936] 10.222.0.102 () {62 vars in 1369 bytes} [Thu Sep 1 17:41:37 2022] POST /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:41:37.587523 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d8c7e6f0-4d05-422c-b575-3687b0ea8e0e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:37.588018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d8c7e6f0-4d05-422c-b575-3687b0ea8e0e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:37.593897 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8c7e6f0-4d05-422c-b575-3687b0ea8e0e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:37.594378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8c7e6f0-4d05-422c-b575-3687b0ea8e0e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:37.594811 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8c7e6f0-4d05-422c-b575-3687b0ea8e0e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:37.595490 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8c7e6f0-4d05-422c-b575-3687b0ea8e0e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:37.595940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8c7e6f0-4d05-422c-b575-3687b0ea8e0e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:37.596360 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d8c7e6f0-4d05-422c-b575-3687b0ea8e0e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:41.017953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d8c7e6f0-4d05-422c-b575-3687b0ea8e0e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "DELETE /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/os-volume_attachments/f229a9a1-5e7d-4a54-85f3-3bdd58b63a14" status: 202 len: 0 microversion: 2.20 time: 3.434391 Sep 01 17:41:41.018726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 462/937] 10.222.0.102 () {60 vars in 1462 bytes} [Thu Sep 1 17:41:37 2022] DELETE /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/os-volume_attachments/f229a9a1-5e7d-4a54-85f3-3bdd58b63a14 => generated 0 bytes in 3436 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:41:41.087274 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:41:41.087865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:41.094581 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:41.095069 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:41.095575 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:41.096271 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:41.096731 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:41.097156 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:41.151362 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121744) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 17:41:41.219875 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3e0d36fc-2a7d-49bb-8d91-8ed58402fb35 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "POST /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/action" status: 202 len: 0 microversion: 2.20 time: 0.137155 Sep 01 17:41:41.221056 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 476/938] 10.222.0.102 () {62 vars in 1324 bytes} [Thu Sep 1 17:41:41 2022] POST /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:41:41.228950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:41.229736 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:41.236795 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:41.237277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:41.237747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:41.238448 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:41.238900 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:41.239318 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:41.398320 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:41.407047 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:41.408467 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:41.409638 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-26ed8d3e-2d78-46e2-9175-913e55967d98 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1737 microversion: 2.20 time: 0.184643 Sep 01 17:41:41.410189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 463/939] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:41 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:42.433806 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:42.434509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:42.441733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:42.442292 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:42.443027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:42.443896 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:42.444342 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:42.444758 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:42.576131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:42.584531 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:42.586024 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:42.587163 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-259b285f-a20b-4e21-8215-d088c80936cb tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.158224 Sep 01 17:41:42.587709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 477/940] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:42 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:43.610730 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:43.611343 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:43.617858 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.618345 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.618778 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:43.619463 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:43.619913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:43.620329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:43.786296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:43.795311 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:43.796964 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:43.798162 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-42702167-768d-4126-af64-984e89d5e39a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.191345 Sep 01 17:41:43.798935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 464/941] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:43 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:44.823428 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:44.824040 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:44.826415 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:44.831965 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:44.832390 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:44.832827 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:44.833553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:44.834010 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:44.834439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:44.976951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:44.986655 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:44.988111 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:44.989399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-703472ca-5cdc-4dc2-a00d-3f24e6c4aca4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.170179 Sep 01 17:41:44.989953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 478/942] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:44 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:45.731725 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:45.732254 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:45.738640 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:45.739119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:45.739552 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:45.740236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:45.740690 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:45.741105 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:45.841275 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lazy-loading 'services' on Instance uuid 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:41:45.917258 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a3cab55f-a99a-45b0-9d4c-70afb1111eac tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "DELETE /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a/os-volume_attachments/dee73889-01ae-49a9-be80-d9238c092fe9" status: 202 len: 0 microversion: 2.1 time: 0.189299 Sep 01 17:41:45.917899 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 465/943] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:41:45 2022] DELETE /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a/os-volume_attachments/dee73889-01ae-49a9-be80-d9238c092fe9 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:41:46.014525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:46.015127 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:46.021523 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:46.022004 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:46.022433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:46.023112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:46.023559 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:46.023974 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:46.170989 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:46.179816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:46.181257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:46.182430 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-46afb477-5c3e-4f79-9f93-10f508f0f8be tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.172438 Sep 01 17:41:46.182981 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 479/944] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:46 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:47.208340 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:47.209026 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:47.212172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=28 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:47.220607 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:47.221338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:47.221922 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:47.222791 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:47.223432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:47.223850 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:47.353123 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:47.362901 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:47.364338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:47.365592 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8f0e7d83-65cd-4e9d-a1b9-f98a78aa5a65 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.162503 Sep 01 17:41:47.377328 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 466/945] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:47 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:48.389075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:48.389719 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:48.396308 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:48.396784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:48.397220 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:48.397940 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:48.398389 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:48.398805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:48.539644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:48.548047 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:48.549514 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:48.550745 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7d61f873-e08a-4d92-803f-7c7596c0422a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.166394 Sep 01 17:41:48.551441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 480/946] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:48 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:49.573886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:49.574496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:49.582194 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:49.582684 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:49.583116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:49.583930 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:49.584378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:49.584929 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:49.760455 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:49.769018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:49.770477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:49.771779 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-641a01f3-2852-4783-9563-bd8078489a21 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.202019 Sep 01 17:41:49.772334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 467/947] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:49 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:50.796450 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:50.796978 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:50.803520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:50.804002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:50.804424 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:50.805111 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:50.805585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:50.806027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:50.957207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:50.966929 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:50.968376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:50.969583 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7a1d426b-8114-4b07-9723-219162a8d79b tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.177553 Sep 01 17:41:50.970133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 481/948] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:50 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:51.996686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:51.997773 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:52.008496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.009296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.010304 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.011707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:52.012681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:52.013413 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:52.151041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:52.160685 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:52.162288 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:52.163461 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7223816f-8e23-45b7-a0c2-c713d692b6e4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.174636 Sep 01 17:41:52.164376 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 468/949] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:51 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:53.186849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:53.187421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:53.194195 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.194672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.195101 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.195782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:53.196230 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:53.196647 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:53.212037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:53.335453 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:53.344303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:53.346059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:53.347237 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-92970ec9-511c-4f2c-b441-eecc5d2172a7 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.165245 Sep 01 17:41:53.353361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 482/950] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:53 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:54.371315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:54.371870 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:54.379125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:54.379603 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:54.380037 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:54.380718 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:54.381168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:54.381677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:54.517726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:54.526700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:54.528149 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:54.529420 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7ef5deb1-3bb7-4035-811f-ded167a58a36 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.162133 Sep 01 17:41:54.538531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 469/951] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:54 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:55.552629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:55.553436 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:55.559657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:55.560133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:55.560560 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:55.561282 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:55.561756 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:55.562177 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:55.696243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:55.704641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:55.706099 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:55.707246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2fb6664d-0897-47bf-accf-b20c24803271 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.158576 Sep 01 17:41:55.707795 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 483/952] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:55 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:56.731485 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:56.732534 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:56.739602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:56.740068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:56.740493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:56.741169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:56.741640 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:56.742080 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:56.744575 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:41:56.883546 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:56.897924 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:56.899477 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:56.900760 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d53cf7ba-da9e-4468-b5c0-ad861f1d0847 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.173631 Sep 01 17:41:56.901436 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 470/953] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:56 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:57.924234 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:57.924833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:57.931250 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:57.931730 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:57.932163 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:57.932841 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:57.933289 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:57.933737 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:58.073028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:58.082451 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:58.083942 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:58.085113 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7f29d6ec-4dea-4fab-aa07-21ce60197781 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.164899 Sep 01 17:41:58.085716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 484/954] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:57 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:41:59.107883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:41:59.108524 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:41:59.114969 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:59.115451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:59.115887 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:59.116572 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:41:59.117041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:41:59.117474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:41:59.241970 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:59.250545 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:59.251977 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:41:59.253210 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-bb131915-5539-46c2-b272-b3d178c96c64 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.149256 Sep 01 17:41:59.253798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 471/955] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:41:59 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:00.276815 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:00.277472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:00.284838 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.285341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.285782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:00.286483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:00.286937 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:00.287361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:00.415327 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:00.423414 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:00.424844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:00.426016 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a016ec51-ec3f-423d-97cc-6b72e98980ad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.153215 Sep 01 17:42:00.426571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 485/956] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:00 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:01.448712 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:01.449634 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:01.456104 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:01.456585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:01.457019 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:01.457734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:01.458192 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:01.458617 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:01.589713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:01.598998 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:01.600440 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:01.601663 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4bf09490-5ad9-43ab-b7b3-8a31ab36947a tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.156867 Sep 01 17:42:01.602222 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 472/957] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:01 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:02.625629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:02.626244 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:02.632656 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:02.633136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:02.633605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:02.634298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:02.634754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:02.635176 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:02.767132 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:02.775223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:02.776703 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:02.777884 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7b6bad80-2f39-4089-8c75-48cdeb3bf491 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.156261 Sep 01 17:42:02.778444 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 486/958] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:02 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:03.801358 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:03.801962 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:03.808458 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:03.808941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:03.809386 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:03.810072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:03.810524 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:03.810938 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:03.938096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:03.946089 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:03.947519 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:03.948696 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2278adf0-fd86-43e4-a9e5-c00452270755 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.151911 Sep 01 17:42:03.949241 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 473/959] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:03 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:04.971523 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:04.972805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:04.979818 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:04.980298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:04.980736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:04.981450 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:04.981905 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:04.982325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:05.110018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:05.118709 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:05.120181 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:05.121336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-26c8e793-fe93-4f33-a843-d87a6f5e94a9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.153843 Sep 01 17:42:05.121895 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 487/960] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:04 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:06.120214 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:06.120757 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:06.127285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.127764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.128200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.128879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.129350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.129773 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.143954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:06.144568 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:06.151079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.151566 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.152004 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.152702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.153159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.153616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.154452 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Going to try to terminate instance {{(pid=121745) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:42:06.235373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cf487d9d-18bd-4210-b494-1598123ba959 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "DELETE /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 204 len: 0 microversion: 2.1 time: 0.118649 Sep 01 17:42:06.236633 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 474/961] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:42:06 2022] DELETE /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:42:06.245124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:06.245851 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:06.251810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.252285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.252712 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.253428 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:06.253885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:06.254302 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:06.297771 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:06.306748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:06.308203 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:06.309381 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-adc25eed-3941-4f64-aac5-f7f2278a5793 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.169408 Sep 01 17:42:06.309971 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 488/962] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:06 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:42:06.384076 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:06.391732 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2710d625-f240-4fe5-aa6b-9d3cd8cb1874 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1516 microversion: 2.1 time: 0.150690 Sep 01 17:42:06.392789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 475/963] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:06 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:07.333399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:07.333986 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:07.340952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.341654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.342096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:07.342875 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.343326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.343748 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:07.392844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-9951994c-c202-4f1c-8e17-903dff6c6084 req-4ad8909d-9583-4998-965e-4a354ae96a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c4bba1-dbe2-4433-837f-4da4534901f8", "name": "network-vif-plugged", "status": "completed", "tag": "568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:07.402486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-9951994c-c202-4f1c-8e17-903dff6c6084 req-4ad8909d-9583-4998-965e-4a354ae96a80 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.402959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-9951994c-c202-4f1c-8e17-903dff6c6084 req-4ad8909d-9583-4998-965e-4a354ae96a80 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.403379 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-9951994c-c202-4f1c-8e17-903dff6c6084 req-4ad8909d-9583-4998-965e-4a354ae96a80 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:07.414616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-9951994c-c202-4f1c-8e17-903dff6c6084 req-4ad8909d-9583-4998-965e-4a354ae96a80 service nova] Creating event network-vif-plugged:568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e for instance 33c4bba1-dbe2-4433-837f-4da4534901f8 on hv-cinder-85221 Sep 01 17:42:07.419526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-9951994c-c202-4f1c-8e17-903dff6c6084 req-4ad8909d-9583-4998-965e-4a354ae96a80 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093931 Sep 01 17:42:07.420405 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 489/964] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:07.425897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:07.427039 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:07.432552 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.432962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.433419 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:07.434099 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:07.434545 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:07.434957 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:07.488311 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:07.496687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:07.498225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:07.499392 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6c70954f-3e45-4106-8920-769e05b17ee9 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.171225 Sep 01 17:42:07.499950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 476/965] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:07 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:42:07.564536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:07.572262 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e1b4c166-15ee-4502-a5c3-d8404f8359a7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1516 microversion: 2.1 time: 0.150777 Sep 01 17:42:07.572816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 490/966] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:07 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:08.522130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:08.522659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:08.529270 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.529774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.530208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.530885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.531336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.531760 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.594008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:08.594925 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:08.602397 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.602953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.603458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.604224 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:08.604786 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:08.605280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:08.667218 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.675407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.676850 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.678038 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1fe438f6-86df-4585-ae33-edd8576ad1a1 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.159994 Sep 01 17:42:08.678597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 477/967] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:08 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:08.745650 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:08.753400 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-980675c4-be47-4e49-a4ab-4c8616f1c504 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1516 microversion: 2.1 time: 0.163657 Sep 01 17:42:08.753963 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 491/968] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:08 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:09.700010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:09.700637 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:09.707780 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.708248 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.708673 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.709370 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.709808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.710226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.775893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:09.776380 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:09.783149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.783639 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.784072 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.784763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:09.785212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:09.785659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:09.880447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.888999 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.890698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.891863 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-bc432e1e-f59a-4219-ab94-3a90d8ad88a4 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1735 microversion: 2.20 time: 0.195800 Sep 01 17:42:09.892415 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 478/969] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:09 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:09.921980 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:09.929557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3c0b5efd-3eae-4de4-81c6-848df2f6a542 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1516 microversion: 2.1 time: 0.157710 Sep 01 17:42:09.930115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 492/970] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:09 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:10.582845 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-36ac6821-a3e5-48d4-bdc6-399930b8b385 req-f79776a8-1d31-4e3c-9f78-36ca5b6271b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ae6b12-3aa6-4faf-8ad2-bd4ec365099a", "name": "network-vif-deleted", "tag": "19c2b4c7-2546-43f4-9584-01f6352632e4"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:10.594653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-36ac6821-a3e5-48d4-bdc6-399930b8b385 req-f79776a8-1d31-4e3c-9f78-36ca5b6271b4 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.595400 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-36ac6821-a3e5-48d4-bdc6-399930b8b385 req-f79776a8-1d31-4e3c-9f78-36ca5b6271b4 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.596626 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-36ac6821-a3e5-48d4-bdc6-399930b8b385 req-f79776a8-1d31-4e3c-9f78-36ca5b6271b4 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.608707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-36ac6821-a3e5-48d4-bdc6-399930b8b385 req-f79776a8-1d31-4e3c-9f78-36ca5b6271b4 service nova] Creating event network-vif-deleted:19c2b4c7-2546-43f4-9584-01f6352632e4 for instance 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a on hv-cinder-85221 Sep 01 17:42:10.614297 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-36ac6821-a3e5-48d4-bdc6-399930b8b385 req-f79776a8-1d31-4e3c-9f78-36ca5b6271b4 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035113 Sep 01 17:42:10.614942 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 479/971] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:10.914418 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:10.915137 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:10.922395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.922921 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.923295 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.923990 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.925771 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.926221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.951894 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:10.952601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:10.959843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.960469 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.960988 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.961824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.962342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.962830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.997719 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:10.998212 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:10.998658 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:10.999095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lazy-loading 'fault' on Instance uuid 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:42:11.048982 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:11.058401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a0d90544-ffab-4c96-a670-0f90770657bf tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 200 len: 1312 microversion: 2.1 time: 0.111504 Sep 01 17:42:11.058964 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 480/972] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:10 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:11.068513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:11.077277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:11.078730 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:11.079884 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ea372f77-e8a3-4a03-949b-5e5636eeb0a8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1722 microversion: 2.20 time: 0.169417 Sep 01 17:42:11.080441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 493/973] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:42:10 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:42:12.080545 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:12.081086 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:12.088035 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:12.088507 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:12.088928 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:12.089629 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:12.090074 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:12.090488 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:12.106382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] HTTP exception thrown: Instance 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a could not be found. Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Request method failure captured: Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a HTTP/1.1 Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO6CmgIIXVU6NQzlgtvx0AEBlyCOZ010fDRKs-UQ3FdFOhGBsXfa2f8Mravj3EmYlpuD3YBjvQnBL1cluwBWrxiBXd_YxigrpHr-rQbPL_6BGhl6tXhZ4KUD9z8A2PwGPxAksp6G71ufjrhZPv5zJ4oyT7XZqXyQCaWbxVMw93MFCho Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 41b4d9513f204230a8ff27614eb1a642 Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1483187283 Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:42:12.108016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_41b4d9513f204230a8ff27614eb1a642", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/41b4d9513f204230a8ff27614eb1a642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/41b4d9513f204230a8ff27614eb1a642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/41b4d9513f204230a8ff27614eb1a642"}]}] Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-VolumesSnapshotTestJSON-1483187283 Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 41b4d9513f204230a8ff27614eb1a642 Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1483187283 Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-VolumesSnapshotTestJSON-1483187283-project Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: d09949305dc04d658d20ec90798aff3c Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-VolumesSnapshotTestJSON-1483187283-project Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a could not be found. Sep 01 17:42:12.109653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '82ae6b12-3aa6-4faf-8ad2-bd4ec365099a'} Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a could not be found. Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:42:12.110511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a could not be found. Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a could not be found. Sep 01 17:42:12.111782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:42:12.112918 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Returning 404 to user: Instance 82ae6b12-3aa6-4faf-8ad2-bd4ec365099a could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:42:12.112918 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1b9efc18-a7b3-4105-91e6-29640fa980f1 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a" status: 404 len: 111 microversion: 2.1 time: 0.033231 Sep 01 17:42:12.112918 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 481/974] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:12 2022] GET /compute/v2.1/servers/82ae6b12-3aa6-4faf-8ad2-bd4ec365099a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:42:26.048449 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1829660222", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "networks": [{"uuid": "58f5e15b-23b8-485a-8903-cd250c9d2485"}]}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:26.057885 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=31 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:26.058703 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=65 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:26.104003 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] validate_networks() for [('58f5e15b-23b8-485a-8903-cd250c9d2485', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:42:26.453083 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:42:26.453570 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:42:26.454041 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:42:26.454445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:42:26.455104 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:42:26.464370 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:26.464847 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:26.465275 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:26.466025 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:26.466473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:26.466893 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:26.485846 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Getting quotas for project 41b4d9513f204230a8ff27614eb1a642. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:42:26.489844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Getting quotas for user d09949305dc04d658d20ec90798aff3c and project 41b4d9513f204230a8ff27614eb1a642. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:42:26.501367 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:42:26.503649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:42:26.549584 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d99057d4-747c-43ae-813e-1b74aa56c57e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.504913 Sep 01 17:42:26.550218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 494/975] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:42:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:42:26.561641 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b0e7d948-d4ca-4fd1-af1e-801d6483cbdb tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:26.562249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b0e7d948-d4ca-4fd1-af1e-801d6483cbdb tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:26.564612 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:26.565260 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:26.622973 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b0e7d948-d4ca-4fd1-af1e-801d6483cbdb tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:26.630901 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b0e7d948-d4ca-4fd1-af1e-801d6483cbdb tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1223 microversion: 2.1 time: 0.073319 Sep 01 17:42:26.631463 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 482/976] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:26 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1223 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:42:27.651627 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:27.652272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:27.658383 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:27.658865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:27.659297 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:27.659980 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:27.660429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:27.660850 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:27.729219 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:27.737033 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c28345a0-a94c-4637-a935-a7f83a1d7c16 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1275 microversion: 2.1 time: 0.089823 Sep 01 17:42:27.737633 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 495/977] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:27 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:28.757676 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:28.758279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:28.765554 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:28.766037 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:28.766504 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:28.767193 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:28.767639 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:28.768059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:28.998853 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:29.006461 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fdaa12f3-d93a-4d5f-87a2-9ab598120509 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1323 microversion: 2.1 time: 0.252665 Sep 01 17:42:29.007011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 483/978] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:28 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:29.280486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-6cc179c2-e322-4a17-b97e-7990a281912e req-cfb8c5e6-48fa-4090-b65d-4c32e4762f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3f41d5-c118-42c5-a2fc-984108ab914f", "tag": "48afe3a5-f9f0-4685-b40f-3be58a954ba0"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:29.292899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6cc179c2-e322-4a17-b97e-7990a281912e req-cfb8c5e6-48fa-4090-b65d-4c32e4762f66 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:29.293409 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6cc179c2-e322-4a17-b97e-7990a281912e req-cfb8c5e6-48fa-4090-b65d-4c32e4762f66 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:29.293879 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6cc179c2-e322-4a17-b97e-7990a281912e req-cfb8c5e6-48fa-4090-b65d-4c32e4762f66 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:29.306205 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-6cc179c2-e322-4a17-b97e-7990a281912e req-cfb8c5e6-48fa-4090-b65d-4c32e4762f66 service nova] Creating event network-changed:48afe3a5-f9f0-4685-b40f-3be58a954ba0 for instance dd3f41d5-c118-42c5-a2fc-984108ab914f on hv-cinder-85221 Sep 01 17:42:29.311322 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-6cc179c2-e322-4a17-b97e-7990a281912e req-cfb8c5e6-48fa-4090-b65d-4c32e4762f66 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034539 Sep 01 17:42:29.311915 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 496/979] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:30.027610 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:30.028145 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:30.034454 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:30.034923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:30.035347 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:30.036018 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:30.036460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:30.036876 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:30.161641 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:30.169764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-de8662f4-ad2d-4744-ad68-a3727e6f524b tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1323 microversion: 2.1 time: 0.146120 Sep 01 17:42:30.170323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 484/980] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:30 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1323 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:31.191188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:31.191883 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:31.199030 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:31.199500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:31.199927 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:31.200607 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:31.201055 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:31.201511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:31.327096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:31.335519 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ae8ee57b-085b-4951-be04-6d1bdef0f63a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1323 microversion: 2.1 time: 0.148577 Sep 01 17:42:31.336072 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 497/981] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:31 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1323 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:32.356015 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:32.356623 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:32.363052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:32.363523 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:32.363946 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:32.364621 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:32.365079 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:32.365514 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:32.494174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:32.502322 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-04a68f6c-9f14-439f-8059-a5d4ed83a9dc tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1323 microversion: 2.1 time: 0.150259 Sep 01 17:42:32.502874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 485/982] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:32 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1323 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:33.523340 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:33.524028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:33.531392 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:33.532074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:33.532477 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:33.533162 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:33.533645 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:33.534048 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:33.665553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:33.673215 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-06e30677-3232-4338-9cd3-2d4dfec01691 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1323 microversion: 2.1 time: 0.154309 Sep 01 17:42:33.673812 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 498/983] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:33 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:34.693928 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:34.694542 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:34.701585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:34.702064 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:34.702498 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:34.703233 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:34.703696 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:34.704148 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:34.834087 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:34.842434 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ee2fd3c3-0a7a-4b7d-b3d1-d96356922bef tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1323 microversion: 2.1 time: 0.152508 Sep 01 17:42:34.842992 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 486/984] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:34 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:35.452412 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-50eba4f6-a893-44a7-870e-76f6b64a2270 req-bd66ac0a-6a07-4836-a94f-f2ccc9b8e40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3f41d5-c118-42c5-a2fc-984108ab914f", "name": "network-vif-plugged", "status": "completed", "tag": "48afe3a5-f9f0-4685-b40f-3be58a954ba0"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:35.462867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-50eba4f6-a893-44a7-870e-76f6b64a2270 req-bd66ac0a-6a07-4836-a94f-f2ccc9b8e40d service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:35.463470 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-50eba4f6-a893-44a7-870e-76f6b64a2270 req-bd66ac0a-6a07-4836-a94f-f2ccc9b8e40d service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:35.464021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-50eba4f6-a893-44a7-870e-76f6b64a2270 req-bd66ac0a-6a07-4836-a94f-f2ccc9b8e40d service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:35.475346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-50eba4f6-a893-44a7-870e-76f6b64a2270 req-bd66ac0a-6a07-4836-a94f-f2ccc9b8e40d service nova] Creating event network-vif-plugged:48afe3a5-f9f0-4685-b40f-3be58a954ba0 for instance dd3f41d5-c118-42c5-a2fc-984108ab914f on hv-cinder-85221 Sep 01 17:42:35.480744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-50eba4f6-a893-44a7-870e-76f6b64a2270 req-bd66ac0a-6a07-4836-a94f-f2ccc9b8e40d service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Sep 01 17:42:35.481367 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 499/985] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:42:35.863016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:35.863627 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:35.870548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:35.871031 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:35.871455 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:35.872140 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:35.872588 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:35.873006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:36.003384 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:36.010990 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7f48aa86-5c1d-4596-b896-6ab49534cfe8 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1323 microversion: 2.1 time: 0.151819 Sep 01 17:42:36.011545 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 487/986] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:35 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1323 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:37.029365 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:37.030172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:37.034341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:37.035035 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:37.042031 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:37.042507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:37.042936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:37.043617 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:37.044062 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:37.044475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:37.174778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:37.182396 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c6cbad78-aa17-479e-9e51-40e09d2c0e29 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1323 microversion: 2.1 time: 0.154450 Sep 01 17:42:37.183448 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 500/987] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:37 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:38.202808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:38.203415 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:38.205369 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:42:38.211340 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:38.212253 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:38.212690 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:38.213397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:38.213855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:38.214890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:38.344020 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:38.356600 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d3abfd0b-496e-4653-b50e-1e4fbb9824d7 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1323 microversion: 2.1 time: 0.157712 Sep 01 17:42:38.357655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 488/988] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:38 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:39.377588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:42:39.378107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:39.384676 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:39.385159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:39.385625 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:39.386319 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:39.386774 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:39.387199 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:39.516182 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:42:39.523909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a17dc334-9c81-4dfa-80b0-5fd29c7c8e39 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1511 microversion: 2.1 time: 0.150397 Sep 01 17:42:39.524468 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 501/989] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:42:39 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:42:39.544703 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a2c1ed7c-7520-4762-92b0-c3d10a189639 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0446e34c-364a-44f2-9584-ca4b246c5738", "device": "/dev/sdb"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:42:39.547096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a2c1ed7c-7520-4762-92b0-c3d10a189639 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:42:39.553147 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a2c1ed7c-7520-4762-92b0-c3d10a189639 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:39.553648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a2c1ed7c-7520-4762-92b0-c3d10a189639 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:39.554134 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a2c1ed7c-7520-4762-92b0-c3d10a189639 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:39.554805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a2c1ed7c-7520-4762-92b0-c3d10a189639 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:42:39.555249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a2c1ed7c-7520-4762-92b0-c3d10a189639 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:42:39.555661 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a2c1ed7c-7520-4762-92b0-c3d10a189639 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:42:39.827281 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a2c1ed7c-7520-4762-92b0-c3d10a189639 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "POST /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286856 Sep 01 17:42:39.827905 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 489/990] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:42:39 2022] POST /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:05.268115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6c0bd75c-1d96-4f5f-90b3-a50ef7e66c82 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:05.268748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6c0bd75c-1d96-4f5f-90b3-a50ef7e66c82 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:05.270654 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:05.271368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=36 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:05.272353 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:43:05.272511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Thu Sep 1 17:43:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/ips (ip 10.222.0.102) !!! Sep 01 17:43:05.280596 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c0bd75c-1d96-4f5f-90b3-a50ef7e66c82 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:05.281085 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c0bd75c-1d96-4f5f-90b3-a50ef7e66c82 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:05.281578 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c0bd75c-1d96-4f5f-90b3-a50ef7e66c82 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:05.282307 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c0bd75c-1d96-4f5f-90b3-a50ef7e66c82 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:05.282761 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c0bd75c-1d96-4f5f-90b3-a50ef7e66c82 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:05.283194 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c0bd75c-1d96-4f5f-90b3-a50ef7e66c82 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:05.309069 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6c0bd75c-1d96-4f5f-90b3-a50ef7e66c82 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/ips" status: 200 len: 145 microversion: 2.1 time: 0.045058 Sep 01 17:43:05.309689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 502/991] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:43:05 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:05.346421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=18 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:05.347256 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:05.351393 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:05.351967 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:05.359427 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:05.359909 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:05.360355 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:05.361033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:05.361512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:05.361932 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:05.446412 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lazy-loading 'services' on Instance uuid dd3f41d5-c118-42c5-a2fc-984108ab914f {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:43:05.522828 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9e749255-f93d-4247-97a0-dd1d4e951be9 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "DELETE /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f/os-volume_attachments/0446e34c-364a-44f2-9584-ca4b246c5738" status: 202 len: 0 microversion: 2.1 time: 0.177633 Sep 01 17:43:05.526884 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 490/992] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:43:05 2022] DELETE /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f/os-volume_attachments/0446e34c-364a-44f2-9584-ca4b246c5738 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:43:07.711179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3d92c358-e06c-4215-9299-15501fc996b9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aaa6bf1-4c02-4b3b-b824-8c6eb57636f1"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:07.713852 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3d92c358-e06c-4215-9299-15501fc996b9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:07.720379 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d92c358-e06c-4215-9299-15501fc996b9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:07.720861 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d92c358-e06c-4215-9299-15501fc996b9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:07.721294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d92c358-e06c-4215-9299-15501fc996b9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:07.722004 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d92c358-e06c-4215-9299-15501fc996b9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:07.722457 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d92c358-e06c-4215-9299-15501fc996b9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:07.722890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d92c358-e06c-4215-9299-15501fc996b9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:07.753729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:43:07.754182 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Thu Sep 1 17:43:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f (ip 10.222.0.102) !!! Sep 01 17:43:07.764813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:07.765411 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:07.771968 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:07.772528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:07.772859 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:07.773565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:07.774013 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:07.774429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:07.801373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Going to try to terminate instance {{(pid=121745) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:43:07.878079 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f4bb97a1-5802-4101-b10c-abe4ed44113a tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "DELETE /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 204 len: 0 microversion: 2.1 time: 0.125832 Sep 01 17:43:07.878661 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 491/993] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:43:07 2022] DELETE /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:43:07.887451 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:07.888186 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:07.895410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:07.895906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:07.896333 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:07.897014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:07.897491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:07.897913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:08.028565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:08.036181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-39c2d384-3fec-43db-9636-63d483f3ea02 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1517 microversion: 2.1 time: 0.153085 Sep 01 17:43:08.037298 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 492/994] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:07 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:09.058109 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:09.059155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:09.068408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:09.068885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:09.069528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:09.070216 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:09.070659 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:09.071069 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:09.197373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:09.204954 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ed4349fd-18f3-482e-9c78-a41a7d0f521d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1517 microversion: 2.1 time: 0.151942 Sep 01 17:43:09.205536 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 493/995] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:09 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:09.858120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3d92c358-e06c-4215-9299-15501fc996b9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.150541 Sep 01 17:43:09.858765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 503/996] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:43:07 2022] POST /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments => generated 194 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:10.225666 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:10.226274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:10.232558 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:10.233032 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:10.233502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:10.234185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:10.234635 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:10.235053 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:10.367183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:10.374874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-813c1238-4ea5-47ca-a075-14a81e38ef6d tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1517 microversion: 2.1 time: 0.153067 Sep 01 17:43:10.375441 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 494/997] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:10 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:11.398441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:11.399085 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:11.406624 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:11.407242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:11.407794 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:11.408500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:11.408957 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:11.409424 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:11.544449 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09949305dc04d658d20ec90798aff3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b4d9513f204230a8ff27614eb1a642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:11.552298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1da5b0ab-674f-48d6-b5ba-fdbf129a893e tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 200 len: 1517 microversion: 2.1 time: 0.159873 Sep 01 17:43:11.552868 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 504/998] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:11 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:43:11.700099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-bcf2af7f-42f5-4ccb-b701-9dbca0f15eb9 req-f3eb991d-10f7-45c8-9e71-dc49526cdab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3f41d5-c118-42c5-a2fc-984108ab914f", "name": "network-vif-deleted", "tag": "48afe3a5-f9f0-4685-b40f-3be58a954ba0"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:11.710721 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-bcf2af7f-42f5-4ccb-b701-9dbca0f15eb9 req-f3eb991d-10f7-45c8-9e71-dc49526cdab6 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:11.711191 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-bcf2af7f-42f5-4ccb-b701-9dbca0f15eb9 req-f3eb991d-10f7-45c8-9e71-dc49526cdab6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:11.711607 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-bcf2af7f-42f5-4ccb-b701-9dbca0f15eb9 req-f3eb991d-10f7-45c8-9e71-dc49526cdab6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:11.722786 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-bcf2af7f-42f5-4ccb-b701-9dbca0f15eb9 req-f3eb991d-10f7-45c8-9e71-dc49526cdab6 service nova] Creating event network-vif-deleted:48afe3a5-f9f0-4685-b40f-3be58a954ba0 for instance dd3f41d5-c118-42c5-a2fc-984108ab914f on hv-cinder-85221 Sep 01 17:43:11.727987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-bcf2af7f-42f5-4ccb-b701-9dbca0f15eb9 req-f3eb991d-10f7-45c8-9e71-dc49526cdab6 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088079 Sep 01 17:43:11.728536 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 495/999] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:12.572629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:12.573235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] [instance: dd3f41d5-c118-42c5-a2fc-984108ab914f] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:12.579683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:12.580161 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:12.580590 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:12.581271 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:12.581744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:12.582163 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:12.595546 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] HTTP exception thrown: Instance dd3f41d5-c118-42c5-a2fc-984108ab914f could not be found. Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Request method failure captured: Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f HTTP/1.1 Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO6CmgIIXVU6NQzlgtvx0AEBlyCOZ010fDRKs-UQ3FdFOhGBsXfa2f8Mravj3EmYlpuD3YBjvQnBL1cluwBWrxiBXd_YxigrpHr-rQbPL_6BGhl6tXhZ4KUD9z8A2PwGPxAksp6G71ufjrhZPv5zJ4oyT7XZqXyQCaWbxVMw93MFCho Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 41b4d9513f204230a8ff27614eb1a642 Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1483187283 Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:43:12.597166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_41b4d9513f204230a8ff27614eb1a642", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/41b4d9513f204230a8ff27614eb1a642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/41b4d9513f204230a8ff27614eb1a642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/41b4d9513f204230a8ff27614eb1a642"}]}] Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-VolumesSnapshotTestJSON-1483187283 Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 41b4d9513f204230a8ff27614eb1a642 Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1483187283 Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-VolumesSnapshotTestJSON-1483187283-project Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: d09949305dc04d658d20ec90798aff3c Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-VolumesSnapshotTestJSON-1483187283-project Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance dd3f41d5-c118-42c5-a2fc-984108ab914f could not be found. Sep 01 17:43:12.598890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'dd3f41d5-c118-42c5-a2fc-984108ab914f'} Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3f41d5-c118-42c5-a2fc-984108ab914f could not be found. Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:43:12.599983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3f41d5-c118-42c5-a2fc-984108ab914f could not be found. Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3f41d5-c118-42c5-a2fc-984108ab914f could not be found. Sep 01 17:43:12.601536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:12.602847 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] Returning 404 to user: Instance dd3f41d5-c118-42c5-a2fc-984108ab914f could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:43:12.602847 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-175af7b0-9753-4878-bfda-6f2ec8799a19 tempest-VolumesSnapshotTestJSON-1483187283 tempest-VolumesSnapshotTestJSON-1483187283-project] 10.222.0.102 "GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f" status: 404 len: 111 microversion: 2.1 time: 0.030506 Sep 01 17:43:12.602847 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 505/1000] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:12 2022] GET /compute/v2.1/servers/dd3f41d5-c118-42c5-a2fc-984108ab914f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:43:21.771766 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4ed4e956-f53e-405e-84f5-c0b5a5a5504e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:21.775249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4ed4e956-f53e-405e-84f5-c0b5a5a5504e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:21.781916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:21.781916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:21.785275 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ed4e956-f53e-405e-84f5-c0b5a5a5504e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:21.785787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ed4e956-f53e-405e-84f5-c0b5a5a5504e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:21.786225 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ed4e956-f53e-405e-84f5-c0b5a5a5504e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:21.786923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ed4e956-f53e-405e-84f5-c0b5a5a5504e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:21.787381 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ed4e956-f53e-405e-84f5-c0b5a5a5504e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:21.787805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4ed4e956-f53e-405e-84f5-c0b5a5a5504e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:21.840037 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4ed4e956-f53e-405e-84f5-c0b5a5a5504e tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072951 Sep 01 17:43:21.840915 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 496/1001] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:43:21 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:43:21.851949 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-316f0c01-30c4-4bc8-99c9-3e757054e3e3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:21.853055 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-316f0c01-30c4-4bc8-99c9-3e757054e3e3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:21.859939 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-316f0c01-30c4-4bc8-99c9-3e757054e3e3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:21.860453 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-316f0c01-30c4-4bc8-99c9-3e757054e3e3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:21.860883 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-316f0c01-30c4-4bc8-99c9-3e757054e3e3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:21.861612 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-316f0c01-30c4-4bc8-99c9-3e757054e3e3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:21.862063 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-316f0c01-30c4-4bc8-99c9-3e757054e3e3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:21.862580 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-316f0c01-30c4-4bc8-99c9-3e757054e3e3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:21.893097 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-316f0c01-30c4-4bc8-99c9-3e757054e3e3 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/6aaa6bf1-4c02-4b3b-b824-8c6eb57636f1" status: 200 len: 194 microversion: 2.1 time: 0.045153 Sep 01 17:43:21.893706 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 506/1002] 10.222.0.102 () {58 vars in 1418 bytes} [Thu Sep 1 17:43:21 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/6aaa6bf1-4c02-4b3b-b824-8c6eb57636f1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:43:23.241092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6a845412-4cf9-4239-b770-89411251a4bc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "436a07b4-fe44-44b4-961a-11d269fb11ce"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:23.244239 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6a845412-4cf9-4239-b770-89411251a4bc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:23.251106 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a845412-4cf9-4239-b770-89411251a4bc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:23.251583 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a845412-4cf9-4239-b770-89411251a4bc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:23.252013 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a845412-4cf9-4239-b770-89411251a4bc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:23.252695 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a845412-4cf9-4239-b770-89411251a4bc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:23.253151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a845412-4cf9-4239-b770-89411251a4bc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:23.253597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6a845412-4cf9-4239-b770-89411251a4bc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:23.537552 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6a845412-4cf9-4239-b770-89411251a4bc tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "POST /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300274 Sep 01 17:43:23.538172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 497/1003] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:43:23 2022] POST /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:37.399341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-4770c70c-11ca-4da0-97a4-643de62889d4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:37.402233 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-4770c70c-11ca-4da0-97a4-643de62889d4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:37.404750 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=10 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:37.405516 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:37.411197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4770c70c-11ca-4da0-97a4-643de62889d4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.411694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4770c70c-11ca-4da0-97a4-643de62889d4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.412100 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4770c70c-11ca-4da0-97a4-643de62889d4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.412778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4770c70c-11ca-4da0-97a4-643de62889d4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.413230 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4770c70c-11ca-4da0-97a4-643de62889d4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.413678 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4770c70c-11ca-4da0-97a4-643de62889d4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.444891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-4770c70c-11ca-4da0-97a4-643de62889d4 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049441 Sep 01 17:43:37.445489 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 507/1004] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:43:37 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:37.584843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=4 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:37.586026 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:43:37.590469 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a8ddb9b8-4cf5-4123-a18b-b036c4938b3a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:37.591061 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a8ddb9b8-4cf5-4123-a18b-b036c4938b3a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:37.598584 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a8ddb9b8-4cf5-4123-a18b-b036c4938b3a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.599067 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a8ddb9b8-4cf5-4123-a18b-b036c4938b3a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.599500 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a8ddb9b8-4cf5-4123-a18b-b036c4938b3a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.600197 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a8ddb9b8-4cf5-4123-a18b-b036c4938b3a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.600645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a8ddb9b8-4cf5-4123-a18b-b036c4938b3a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.601058 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a8ddb9b8-4cf5-4123-a18b-b036c4938b3a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.633091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a8ddb9b8-4cf5-4123-a18b-b036c4938b3a tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/6aaa6bf1-4c02-4b3b-b824-8c6eb57636f1" status: 200 len: 194 microversion: 2.1 time: 0.049637 Sep 01 17:43:37.633895 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 498/1005] 10.222.0.102 () {58 vars in 1418 bytes} [Thu Sep 1 17:43:37 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/6aaa6bf1-4c02-4b3b-b824-8c6eb57636f1 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:37.644004 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:37.644500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:37.650529 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.651014 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.651478 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.652173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:37.652625 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:37.653075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:37.733730 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lazy-loading 'services' on Instance uuid 84b9974e-1129-41ba-8a64-383db67ca891 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:43:37.819015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7a2610f9-0f14-4f91-b972-67ee3173c6c2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "DELETE /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/6aaa6bf1-4c02-4b3b-b824-8c6eb57636f1" status: 202 len: 0 microversion: 2.1 time: 0.174157 Sep 01 17:43:37.819015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 508/1006] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:43:37 2022] DELETE /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/6aaa6bf1-4c02-4b3b-b824-8c6eb57636f1 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:43:39.994185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d6492330-a777-4876-a898-184389d0c004 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:39.994675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d6492330-a777-4876-a898-184389d0c004 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:40.001612 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6492330-a777-4876-a898-184389d0c004 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:40.002092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6492330-a777-4876-a898-184389d0c004 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:40.002528 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6492330-a777-4876-a898-184389d0c004 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:40.003206 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6492330-a777-4876-a898-184389d0c004 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:40.003657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6492330-a777-4876-a898-184389d0c004 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:40.004072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d6492330-a777-4876-a898-184389d0c004 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:40.033549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d6492330-a777-4876-a898-184389d0c004 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/436a07b4-fe44-44b4-961a-11d269fb11ce" status: 200 len: 194 microversion: 2.1 time: 0.043366 Sep 01 17:43:40.034135 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 499/1007] 10.222.0.102 () {58 vars in 1418 bytes} [Thu Sep 1 17:43:39 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/436a07b4-fe44-44b4-961a-11d269fb11ce => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:40.046321 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:40.049779 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:40.056862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:40.057472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:40.057969 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:40.059220 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:40.059732 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:40.060225 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:40.144464 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lazy-loading 'services' on Instance uuid 84b9974e-1129-41ba-8a64-383db67ca891 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:43:40.217785 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-33511707-7122-4cad-a825-53f32aeff6d9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "DELETE /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/436a07b4-fe44-44b4-961a-11d269fb11ce" status: 202 len: 0 microversion: 2.1 time: 0.175848 Sep 01 17:43:40.218234 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 509/1008] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:43:40 2022] DELETE /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments/436a07b4-fe44-44b4-961a-11d269fb11ce => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:43:41.401889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-5403a875-90ee-4f5a-8144-13c80d36d07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:41.404573 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-5403a875-90ee-4f5a-8144-13c80d36d07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:41.410941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5403a875-90ee-4f5a-8144-13c80d36d07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.411426 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5403a875-90ee-4f5a-8144-13c80d36d07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.411863 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5403a875-90ee-4f5a-8144-13c80d36d07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.412548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5403a875-90ee-4f5a-8144-13c80d36d07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.413006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5403a875-90ee-4f5a-8144-13c80d36d07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.413481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-5403a875-90ee-4f5a-8144-13c80d36d07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.442180 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-5403a875-90ee-4f5a-8144-13c80d36d07d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044212 Sep 01 17:43:41.442655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 500/1009] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:43:41 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:43:41.553159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e5d2e55a-2b72-4e62-afc6-850e1e5df9f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:41.555566 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e5d2e55a-2b72-4e62-afc6-850e1e5df9f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:41.562294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5d2e55a-2b72-4e62-afc6-850e1e5df9f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.562778 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5d2e55a-2b72-4e62-afc6-850e1e5df9f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.563205 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5d2e55a-2b72-4e62-afc6-850e1e5df9f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.563883 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5d2e55a-2b72-4e62-afc6-850e1e5df9f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.564334 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5d2e55a-2b72-4e62-afc6-850e1e5df9f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.564748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e5d2e55a-2b72-4e62-afc6-850e1e5df9f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.594404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e5d2e55a-2b72-4e62-afc6-850e1e5df9f9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046164 Sep 01 17:43:41.594936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 510/1010] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:43:41 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:43:41.654644 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:41.655120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:41.660965 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.661483 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.661915 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.662618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.663070 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.663482 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.689103 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Going to try to terminate instance {{(pid=121745) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:43:41.767715 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d2e4f952-4d6f-45e3-96ff-bf7f526b066d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "DELETE /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 204 len: 0 microversion: 2.1 time: 0.117115 Sep 01 17:43:41.768226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 501/1011] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:43:41 2022] DELETE /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:43:41.777783 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:41.778429 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:41.784331 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.784835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.785328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.786043 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:41.786520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:41.786944 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:41.919736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:41.927445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5f3a6751-bacd-4f14-8ca4-b4397dcf944d tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1676 microversion: 2.1 time: 0.153881 Sep 01 17:43:41.928003 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 511/1012] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:41 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:42.948781 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:42.950072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:42.956341 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:42.956816 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:42.957246 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:42.957950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:42.958408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:42.958829 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:43.098239 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:43.106564 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3f7dc5fe-6a24-474e-8c60-302a7a8cdd03 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1676 microversion: 2.1 time: 0.162097 Sep 01 17:43:43.107124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 502/1013] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:42 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:44.128070 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:44.128618 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:44.134985 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:44.135464 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:44.135889 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:44.136567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:44.137549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:44.137966 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:44.264690 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:44.272301 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f0726c09-9b9b-443d-9151-328597b67094 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1676 microversion: 2.1 time: 0.148195 Sep 01 17:43:44.272857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 512/1014] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:44 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:45.295419 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:45.296065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:45.302518 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:45.302997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:45.303432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:45.304124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:45.304573 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:45.305097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:45.368677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-99ef8de3-1511-4a61-84f6-ab3ae02dc6f2 req-a9866727-0d50-495e-9a70-de0af86f55c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b9974e-1129-41ba-8a64-383db67ca891", "name": "network-vif-deleted", "tag": "c41b96e8-8833-4515-b4c4-0fea0ffe7475"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:45.380463 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-99ef8de3-1511-4a61-84f6-ab3ae02dc6f2 req-a9866727-0d50-495e-9a70-de0af86f55c9 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:45.380944 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-99ef8de3-1511-4a61-84f6-ab3ae02dc6f2 req-a9866727-0d50-495e-9a70-de0af86f55c9 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:45.381444 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-99ef8de3-1511-4a61-84f6-ab3ae02dc6f2 req-a9866727-0d50-495e-9a70-de0af86f55c9 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:45.399599 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae0aab3e503249d49ff9473b4990ff63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb1cbe315441258828677997dd6fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:45.410784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-99ef8de3-1511-4a61-84f6-ab3ae02dc6f2 req-a9866727-0d50-495e-9a70-de0af86f55c9 service nova] Creating event network-vif-deleted:c41b96e8-8833-4515-b4c4-0fea0ffe7475 for instance 84b9974e-1129-41ba-8a64-383db67ca891 on hv-cinder-85221 Sep 01 17:43:45.412207 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-66e2bffd-cb80-455c-b9a6-976cc0a3edb5 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 200 len: 1608 microversion: 2.1 time: 0.121728 Sep 01 17:43:45.413391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 503/1015] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:45 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 1608 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:45.430455 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-99ef8de3-1511-4a61-84f6-ab3ae02dc6f2 req-a9866727-0d50-495e-9a70-de0af86f55c9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066125 Sep 01 17:43:45.431235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 513/1016] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:46.437785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:46.438421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:46.444813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:46.445292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:46.445755 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:46.446435 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:46.446885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:46.447302 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:46.461122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] HTTP exception thrown: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Request method failure captured: Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 HTTP/1.1 Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOzFHa03N2OcQ4ZycXCiMUAiFuFh9RrmOnws7LbVcWWwX_7SIhSI6Gk0JzOi2V9UMhNi-VCR2-CCpf7nO3bNNqEspJ-3SbPOQaRQSnKVbgWWu1i9rh-TxKxMT8muqDtLkVFPtMeYfYLLAzmf1SsejQNQDO0pIdjFvL__AZwuY9wPTVU Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:43:46.462798 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_19bb1cbe315441258828677997dd6fdf", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}] Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: ae0aab3e503249d49ff9473b4990ff63 Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:46.464414 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '84b9974e-1129-41ba-8a64-383db67ca891'} Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:43:46.465416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:46.466984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:46.468698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Returning 404 to user: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:43:46.468698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3ff2beae-d998-48db-be50-8c87c20d94e2 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 404 len: 111 microversion: 2.1 time: 0.030955 Sep 01 17:43:46.468698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 504/1017] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:46 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:43:46.474563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-30f258d1-8ffa-4d21-96f0-8722bbe5ef0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '.version_select at 0x7fb856793430>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:46.495853 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-30f258d1-8ffa-4d21-96f0-8722bbe5ef0f tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-426026503" status: 202 len: 0 microversion: 2.1 time: 0.025920 Sep 01 17:43:46.496341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 514/1018] 10.222.0.102 () {58 vars in 1223 bytes} [Thu Sep 1 17:43:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-426026503 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:43:49.359413 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:49.359906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:49.366426 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:49.366908 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:49.367339 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:49.368024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:49.368474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:49.368897 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:49.383488 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] HTTP exception thrown: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Request method failure captured: Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: DELETE /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 HTTP/1.1 Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOzFHa03N2OcQ4ZycXCiMUAiFuFh9RrmOnws7LbVcWWwX_7SIhSI6Gk0JzOi2V9UMhNi-VCR2-CCpf7nO3bNNqEspJ-3SbPOQaRQSnKVbgWWu1i9rh-TxKxMT8muqDtLkVFPtMeYfYLLAzmf1SsejQNQDO0pIdjFvL__AZwuY9wPTVU Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:43:49.385014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_19bb1cbe315441258828677997dd6fdf", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}] Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: ae0aab3e503249d49ff9473b4990ff63 Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.386548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '84b9974e-1129-41ba-8a64-383db67ca891'} Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:43:49.387294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.389052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.390310 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Returning 404 to user: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:43:49.390310 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c7e0831c-2396-404c-9d71-a0b668999731 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "DELETE /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 404 len: 111 microversion: 2.1 time: 0.030877 Sep 01 17:43:49.390310 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 505/1019] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:43:49 2022] DELETE /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:43:49.396302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:49.397036 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 84b9974e-1129-41ba-8a64-383db67ca891] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:49.404528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:49.405008 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:49.405469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:49.406179 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:49.406661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:49.407103 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:49.420199 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] HTTP exception thrown: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Request method failure captured: Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 HTTP/1.1 Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOzFHa03N2OcQ4ZycXCiMUAiFuFh9RrmOnws7LbVcWWwX_7SIhSI6Gk0JzOi2V9UMhNi-VCR2-CCpf7nO3bNNqEspJ-3SbPOQaRQSnKVbgWWu1i9rh-TxKxMT8muqDtLkVFPtMeYfYLLAzmf1SsejQNQDO0pIdjFvL__AZwuY9wPTVU Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:43:49.421856 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_19bb1cbe315441258828677997dd6fdf", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}] Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: ae0aab3e503249d49ff9473b4990ff63 Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.423500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '84b9974e-1129-41ba-8a64-383db67ca891'} Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:43:49.424368 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. Sep 01 17:43:49.425907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:49.427238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Returning 404 to user: Instance 84b9974e-1129-41ba-8a64-383db67ca891 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:43:49.427238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f19b8055-2c96-4441-b954-340e93bc9bfe tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891" status: 404 len: 111 microversion: 2.1 time: 0.031806 Sep 01 17:43:49.427238 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 515/1020] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:49 2022] GET /compute/v2.1/servers/84b9974e-1129-41ba-8a64-383db67ca891 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:43:50.562569 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:50.563094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:50.570827 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:50.571672 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:50.572461 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:50.573709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:50.574481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:50.574920 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:50.590329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] HTTP exception thrown: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Request method failure captured: Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: DELETE /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 HTTP/1.1 Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOzFHa03N2OcQ4ZycXCiMUAiFuFh9RrmOnws7LbVcWWwX_7SIhSI6Gk0JzOi2V9UMhNi-VCR2-CCpf7nO3bNNqEspJ-3SbPOQaRQSnKVbgWWu1i9rh-TxKxMT8muqDtLkVFPtMeYfYLLAzmf1SsejQNQDO0pIdjFvL__AZwuY9wPTVU Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:43:50.592391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_19bb1cbe315441258828677997dd6fdf", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}] Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: ae0aab3e503249d49ff9473b4990ff63 Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.594274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '14064865-1bc2-4b27-993b-cd5e726de947'} Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:43:50.595195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.596692 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.598245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Returning 404 to user: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:43:50.598245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a08d170c-36b3-4222-b424-7d9d58c585ff tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "DELETE /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 404 len: 111 microversion: 2.1 time: 0.035146 Sep 01 17:43:50.598245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 506/1021] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:43:50 2022] DELETE /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:43:50.603469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:50.604083 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] [instance: 14064865-1bc2-4b27-993b-cd5e726de947] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:50.611289 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:50.611795 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:50.612249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:50.612979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:50.613519 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:50.613948 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:50.628095 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] HTTP exception thrown: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Request method failure captured: Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 HTTP/1.1 Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOzFHa03N2OcQ4ZycXCiMUAiFuFh9RrmOnws7LbVcWWwX_7SIhSI6Gk0JzOi2V9UMhNi-VCR2-CCpf7nO3bNNqEspJ-3SbPOQaRQSnKVbgWWu1i9rh-TxKxMT8muqDtLkVFPtMeYfYLLAzmf1SsejQNQDO0pIdjFvL__AZwuY9wPTVU Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:43:50.629938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_19bb1cbe315441258828677997dd6fdf", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/19bb1cbe315441258828677997dd6fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/19bb1cbe315441258828677997dd6fdf"}]}] Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 19bb1cbe315441258828677997dd6fdf Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-640097492 Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: ae0aab3e503249d49ff9473b4990ff63 Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeTestJSON-640097492-project Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.631479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '14064865-1bc2-4b27-993b-cd5e726de947'} Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:43:50.632280 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. Sep 01 17:43:50.633550 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:43:50.634671 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] Returning 404 to user: Instance 14064865-1bc2-4b27-993b-cd5e726de947 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:43:50.634671 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a870fc20-56f3-42ec-90d9-75fe9d29adb9 tempest-AttachVolumeTestJSON-640097492 tempest-AttachVolumeTestJSON-640097492-project] 10.222.0.102 "GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947" status: 404 len: 111 microversion: 2.1 time: 0.031910 Sep 01 17:43:50.634671 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 516/1022] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:43:50 2022] GET /compute/v2.1/servers/14064865-1bc2-4b27-993b-cd5e726de947 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:43:55.043648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-416980c3-4bfe-41d1-af65-178ae48f722f tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] Action: 'create', calling method: .version_select at 0x7fb8567859d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2027486853", "metadata": {"Type": "work"}}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:55.335780 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-416980c3-4bfe-41d1-af65-178ae48f722f tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] 10.222.0.102 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.414035 Sep 01 17:43:55.345059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 507/1023] 10.222.0.102 () {60 vars in 1161 bytes} [Thu Sep 1 17:43:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 415 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Sep 01 17:43:55.353190 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-274a875b-8e33-4459-9951-1b9bb36c9aa8 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] Calling method '.version_select at 0x7fb8567a3700>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:55.403214 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-274a875b-8e33-4459-9951-1b9bb36c9aa8 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12" status: 200 len: 353 microversion: 2.1 time: 0.056414 Sep 01 17:43:55.403779 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 517/1024] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:43:55 2022] GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:55.983114 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8cecf2b2-2e4b-40f4-b260-26c9f3ec4537 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:55.985430 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8cecf2b2-2e4b-40f4-b260-26c9f3ec4537 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:55.992258 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cecf2b2-2e4b-40f4-b260-26c9f3ec4537 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:55.992735 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cecf2b2-2e4b-40f4-b260-26c9f3ec4537 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:55.993167 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cecf2b2-2e4b-40f4-b260-26c9f3ec4537 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:55.993877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cecf2b2-2e4b-40f4-b260-26c9f3ec4537 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:55.994379 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cecf2b2-2e4b-40f4-b260-26c9f3ec4537 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:55.994820 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8cecf2b2-2e4b-40f4-b260-26c9f3ec4537 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:56.023698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8cecf2b2-2e4b-40f4-b260-26c9f3ec4537 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045774 Sep 01 17:43:56.024261 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 508/1025] 10.222.0.102 () {60 vars in 1348 bytes} [Thu Sep 1 17:43:55 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:43:56.085740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:56.086283 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:56.093547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:56.094023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:56.094716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:56.095393 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:56.095836 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:56.096250 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:56.122005 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:43:56.195475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-61794ade-ce5c-4cfa-94f9-665715de3248 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "DELETE /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 204 len: 0 microversion: 2.20 time: 0.113362 Sep 01 17:43:56.196315 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 518/1026] 10.222.0.102 () {60 vars in 1285 bytes} [Thu Sep 1 17:43:56 2022] DELETE /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 17:43:56.205091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:56.205723 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:56.211713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:56.212187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:56.212617 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:56.213374 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:56.213824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:56.214249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:56.342051 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:56.350595 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:56.352027 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:56.353179 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ec8546a1-93a4-4bc6-b7c5-320ae55da7fd tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.152130 Sep 01 17:43:56.353762 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 509/1027] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:56 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:43:56.417784 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ce1bd7a7-a25d-45eb-ac5a-0b8fa0262c6e tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] Calling method '.version_select at 0x7fb8569e80d0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:56.468956 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ce1bd7a7-a25d-45eb-ac5a-0b8fa0262c6e tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12" status: 200 len: 354 microversion: 2.1 time: 0.055573 Sep 01 17:43:56.469825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 519/1028] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:43:56 2022] GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:56.482042 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6077361d-1485-4d8f-b34d-167876c2e51f tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] Calling method '.version_select at 0x7fb856510d30>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:56.527566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6077361d-1485-4d8f-b34d-167876c2e51f tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12" status: 200 len: 354 microversion: 2.1 time: 0.049255 Sep 01 17:43:56.528118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 510/1029] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:43:56 2022] GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:56.544760 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1d39e616-2f6e-4a32-9499-42cf77bcd859 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] Calling method '.version_select at 0x7fb8567ca5e0>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:56.603304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1d39e616-2f6e-4a32-9499-42cf77bcd859 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] 10.222.0.102 "DELETE /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12" status: 202 len: 0 microversion: 2.1 time: 0.062316 Sep 01 17:43:56.603924 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 520/1030] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:43:56 2022] DELETE /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:43:56.611890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-101a6498-5606-43b8-b34e-ad83c68c6402 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] Calling method '.version_select at 0x7fb8565b33a0>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:56.660200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-101a6498-5606-43b8-b34e-ad83c68c6402 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12" status: 200 len: 353 microversion: 2.1 time: 0.051962 Sep 01 17:43:56.660805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 511/1031] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:43:56 2022] GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:57.375042 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:57.375766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:57.382495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:57.382977 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:57.383413 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:57.384091 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:57.384543 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:57.384966 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:57.511685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:57.520256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:57.521756 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:57.522906 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ad197834-7803-47b7-be59-754abc0bfb09 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.151839 Sep 01 17:43:57.523449 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 521/1032] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:57 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:57.674864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9f82e3a4-96bc-4b5f-90fb-e4d0a0c21e80 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] Calling method '.version_select at 0x7fb856785670>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:57.703041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-9f82e3a4-96bc-4b5f-90fb-e4d0a0c21e80 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] HTTP exception thrown: Volume 511a352c-f879-4302-9b8e-3d6a66cddc12 could not be found. Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9f82e3a4-96bc-4b5f-90fb-e4d0a0c21e80 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] Request method failure captured: Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12 HTTP/1.1 Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO9aG2pBmSJ6FO8x37rQpWntYg7p9Sv67zKieFSEG4I2qzH_IRpgeDGazVzKJbGiT2S-rZgsKA1qvkJsMmHbzc-xhaF-n2hofI1F_0XEClhFZApbNnvryIU_DhAqWwV6JG_qVad9Kk1X5yXGQB3ciX6AP5JFkPBfZqyOrvlr6CX_sa0 Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 9078902a80fe43598d2ef993c60fe908 Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-VolumesGetTestJSON-2134613020 Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:43:57.705118 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_9078902a80fe43598d2ef993c60fe908", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9078902a80fe43598d2ef993c60fe908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/9078902a80fe43598d2ef993c60fe908"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/9078902a80fe43598d2ef993c60fe908"}]}] Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-VolumesGetTestJSON-2134613020 Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 9078902a80fe43598d2ef993c60fe908 Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-VolumesGetTestJSON-2134613020 Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-VolumesGetTestJSON-2134613020-project Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: e75eed4c0f6c4b83b7bc8daae0898764 Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-VolumesGetTestJSON-2134613020-project Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Volume 511a352c-f879-4302-9b8e-3d6a66cddc12 could not be found. Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '511a352c-f879-4302-9b8e-3d6a66cddc12'} Sep 01 17:43:57.706886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 511a352c-f879-4302-9b8e-3d6a66cddc12 could not be found. (HTTP 404) (Request-ID: req-4a47ee34-ec73-4c73-8561-44ffa7877973) Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:57.707813 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 17:43:57.709033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 511a352c-f879-4302-9b8e-3d6a66cddc12 could not be found. Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 17:43:57.710487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 511a352c-f879-4302-9b8e-3d6a66cddc12 could not be found. Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 511a352c-f879-4302-9b8e-3d6a66cddc12 could not be found. Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9f82e3a4-96bc-4b5f-90fb-e4d0a0c21e80 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] Returning 404 to user: Volume 511a352c-f879-4302-9b8e-3d6a66cddc12 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9f82e3a4-96bc-4b5f-90fb-e4d0a0c21e80 tempest-VolumesGetTestJSON-2134613020 tempest-VolumesGetTestJSON-2134613020-project] 10.222.0.102 "GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12" status: 404 len: 109 microversion: 2.1 time: 0.036082 Sep 01 17:43:57.711864 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 512/1033] 10.222.0.102 () {58 vars in 1250 bytes} [Thu Sep 1 17:43:57 2022] GET /compute/v2.1/os-volumes/511a352c-f879-4302-9b8e-3d6a66cddc12 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:43:58.546109 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:58.546851 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:58.553530 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:58.554019 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:58.554457 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:58.555152 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:58.555674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:58.556269 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:58.698450 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:58.707619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:58.709233 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:58.710439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ee439b81-8f8e-4dc2-9d59-c02a5dd23aad tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1728 microversion: 2.20 time: 0.168503 Sep 01 17:43:58.725693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 522/1034] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:58 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:43:59.264574 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-8ba48c02-621d-4306-b603-a13d372bbcc2 req-e4c2f09a-602c-4bb7-ba14-ec334ab5f1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c4bba1-dbe2-4433-837f-4da4534901f8", "name": "network-vif-deleted", "tag": "568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:43:59.274516 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-8ba48c02-621d-4306-b603-a13d372bbcc2 req-e4c2f09a-602c-4bb7-ba14-ec334ab5f1c1 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:59.275015 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-8ba48c02-621d-4306-b603-a13d372bbcc2 req-e4c2f09a-602c-4bb7-ba14-ec334ab5f1c1 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:59.275739 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-8ba48c02-621d-4306-b603-a13d372bbcc2 req-e4c2f09a-602c-4bb7-ba14-ec334ab5f1c1 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:59.296886 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-8ba48c02-621d-4306-b603-a13d372bbcc2 req-e4c2f09a-602c-4bb7-ba14-ec334ab5f1c1 service nova] Creating event network-vif-deleted:568ba567-a54f-4b12-bc8e-3d2a9e0e2c6e for instance 33c4bba1-dbe2-4433-837f-4da4534901f8 on hv-cinder-85221 Sep 01 17:43:59.303362 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-8ba48c02-621d-4306-b603-a13d372bbcc2 req-e4c2f09a-602c-4bb7-ba14-ec334ab5f1c1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043463 Sep 01 17:43:59.303961 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 513/1035] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:43:59.734452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:43:59.735064 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:43:59.742303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:59.742723 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:59.743351 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:59.744053 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:59.744508 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:59.744933 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:59.777570 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:43:59.778061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:43:59.778507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:43:59.778954 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lazy-loading 'fault' on Instance uuid 33c4bba1-dbe2-4433-837f-4da4534901f8 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:43:59.823669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:59.834471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:59.835958 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26bf17f1fb8948008fed82f4ba33bf66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97796d8be4794e89a89965af17bb3fa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:43:59.837431 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-59157caa-201b-4751-9b28-f93423ba24f8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 200 len: 1376 microversion: 2.20 time: 0.107471 Sep 01 17:43:59.838593 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 523/1036] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:43:59 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 1376 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:44:00.866315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:00.867013 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:00.873819 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:00.874298 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:00.874729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:00.875407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:00.875857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:00.876277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:00.891625 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] HTTP exception thrown: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Request method failure captured: Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 HTTP/1.1 Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxma2FgyTsC6cDAwx1Qenr9c2MeYVTECG0FZEKOY2to7JExjBEtoKRvgnpLWxHxiFNn02km7iPeToINKKsoESJwZy3KvZEoKRIkfF3oa2dtKYRAGDkhBW-T5smj5JIwu7MeAshPgvJ7sYQsky_MguEXvxxoJNBppmU7DsA7rsgO4Iw Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:44:00.893245 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_97796d8be4794e89a89965af17bb3fa9", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}] Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 26bf17f1fb8948008fed82f4ba33bf66 Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:00.895014 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '33c4bba1-dbe2-4433-837f-4da4534901f8'} Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:00.895983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:00.897657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:00.899394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Returning 404 to user: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:00.899394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-63b88e4d-5563-40d9-8dac-8eefcab781e2 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 404 len: 111 microversion: 2.20 time: 0.033307 Sep 01 17:44:00.899394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 514/1037] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:44:00 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:44:00.903359 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a92add9c-ae53-45c8-bffc-b6e3d9474ca8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '.version_select at 0x7fb856835430>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:00.922611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a92add9c-ae53-45c8-bffc-b6e3d9474ca8 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015779580" status: 204 len: 0 microversion: 2.20 time: 0.023020 Sep 01 17:44:00.923167 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 524/1038] 10.222.0.102 () {60 vars in 1267 bytes} [Thu Sep 1 17:44:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015779580 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 17:44:02.412002 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:02.412523 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:02.415361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-d364f657-e01d-4b3c-a973-54604316db7a req-f387a2c8-61a2-46ad-81f2-51c560c73384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1df560e-95ad-4efd-9e8e-9252fe66397b", "tag": "28779c04-5b79-4148-9856-ace8639fe9d0"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:02.418889 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.419365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.419815 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.421391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.422022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.422443 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.426913 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-d364f657-e01d-4b3c-a973-54604316db7a req-f387a2c8-61a2-46ad-81f2-51c560c73384 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.427669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-d364f657-e01d-4b3c-a973-54604316db7a req-f387a2c8-61a2-46ad-81f2-51c560c73384 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.428175 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-d364f657-e01d-4b3c-a973-54604316db7a req-f387a2c8-61a2-46ad-81f2-51c560c73384 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.440509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-d364f657-e01d-4b3c-a973-54604316db7a req-f387a2c8-61a2-46ad-81f2-51c560c73384 service nova] Creating event network-changed:28779c04-5b79-4148-9856-ace8639fe9d0 for instance d1df560e-95ad-4efd-9e8e-9252fe66397b on hv-cinder-85221 Sep 01 17:44:02.446124 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-d364f657-e01d-4b3c-a973-54604316db7a req-f387a2c8-61a2-46ad-81f2-51c560c73384 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035556 Sep 01 17:44:02.447075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 525/1039] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:02.449480 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Going to try to terminate instance {{(pid=121745) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:44:02.528283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1881d144-cff3-4c96-8e5a-bd1be1a066d4 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "DELETE /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 204 len: 0 microversion: 2.1 time: 0.119714 Sep 01 17:44:02.532768 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 515/1040] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:44:02 2022] DELETE /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:02.547960 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:02.549392 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:02.561418 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.562152 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.562888 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.563702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.564392 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.564821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.709345 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:02.709964 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:02.715952 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.716396 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:02.716555 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.717475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.718185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.718640 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.719057 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.725439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b526b4ee-4fd3-4fe9-b8bc-a0a7f53e04eb tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1580 microversion: 2.1 time: 0.186461 Sep 01 17:44:02.734056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] HTTP exception thrown: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Request method failure captured: Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: DELETE /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 HTTP/1.1 Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxma2FgyTsC6cDAwx1Qenr9c2MeYVTECG0FZEKOY2to7JExjBEtoKRvgnpLWxHxiFNn02km7iPeToINKKsoESJwZy3KvZEoKRIkfF3oa2dtKYRAGDkhBW-T5smj5JIwu7MeAshPgvJ7sYQsky_MguEXvxxoJNBppmU7DsA7rsgO4Iw Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:44:02.736602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_97796d8be4794e89a89965af17bb3fa9", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}] Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 26bf17f1fb8948008fed82f4ba33bf66 Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.738030 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '33c4bba1-dbe2-4433-837f-4da4534901f8'} Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:02.738782 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.739985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.741538 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 526/1041] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:02 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1580 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:02.742614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Returning 404 to user: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:02.743535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b436b5ea-bf67-4c9f-8c71-abe415597619 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "DELETE /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 404 len: 111 microversion: 2.20 time: 0.038640 Sep 01 17:44:02.744164 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 516/1042] 10.222.0.102 () {60 vars in 1285 bytes} [Thu Sep 1 17:44:02 2022] DELETE /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 17:44:02.752779 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:02.753541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: 33c4bba1-dbe2-4433-837f-4da4534901f8] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:02.760965 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.762013 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.762986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.763695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:02.765343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:02.765535 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:02.780164 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] HTTP exception thrown: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Request method failure captured: Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 HTTP/1.1 Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOxma2FgyTsC6cDAwx1Qenr9c2MeYVTECG0FZEKOY2to7JExjBEtoKRvgnpLWxHxiFNn02km7iPeToINKKsoESJwZy3KvZEoKRIkfF3oa2dtKYRAGDkhBW-T5smj5JIwu7MeAshPgvJ7sYQsky_MguEXvxxoJNBppmU7DsA7rsgO4Iw Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:44:02.781863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_97796d8be4794e89a89965af17bb3fa9", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}] Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 26bf17f1fb8948008fed82f4ba33bf66 Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.783243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '33c4bba1-dbe2-4433-837f-4da4534901f8'} Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:02.784068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. Sep 01 17:44:02.785242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:02.786360 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Returning 404 to user: Instance 33c4bba1-dbe2-4433-837f-4da4534901f8 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:02.786360 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-746ae6a9-b1e6-491d-96be-9b3a0b13efa5 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8" status: 404 len: 111 microversion: 2.20 time: 0.035017 Sep 01 17:44:02.786360 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 527/1043] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:44:02 2022] GET /compute/v2.1/servers/33c4bba1-dbe2-4433-837f-4da4534901f8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:44:03.748324 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:03.748877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:03.755315 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:03.755814 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:03.756253 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:03.756935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:03.757415 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:03.757842 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:03.888285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:03.900388 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a09059ab-9638-498c-8331-cb08e89ef32d tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1580 microversion: 2.1 time: 0.156021 Sep 01 17:44:03.900937 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 517/1044] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:03 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:04.920862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:04.921536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:04.927917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:04.928402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:04.928833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:04.929558 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:04.930011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:04.930432 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:04.950910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:05.069476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:05.079323 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-40d83402-d468-46a4-a18d-cd114b9f5efa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1580 microversion: 2.1 time: 0.162191 Sep 01 17:44:05.079950 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 528/1045] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:04 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1580 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:06.101097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:06.101713 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:06.108714 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:06.109194 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:06.109715 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:06.110401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:06.110848 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:06.111272 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:06.237987 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:06.245737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3b97241a-144a-41ac-82ef-ae075d42a0aa tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1580 microversion: 2.1 time: 0.148582 Sep 01 17:44:06.246295 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 518/1046] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:06 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1580 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:07.267440 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:07.268054 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:07.274900 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:07.275694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:07.276469 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:07.277641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:07.278330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:07.279067 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:07.419601 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:07.427463 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-dd69c9a3-6a63-4434-84f1-f2c5646e6863 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1580 microversion: 2.1 time: 0.164442 Sep 01 17:44:07.428037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 529/1047] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:07 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1580 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:08.448604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:08.449146 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:08.451893 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:08.457882 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:08.458380 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:08.458816 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:08.459521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:08.459980 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:08.460500 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:08.465491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:08.698505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:08.706616 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f4ab7257-2b9a-47b6-b532-9ff17384cb31 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1461 microversion: 2.1 time: 0.262023 Sep 01 17:44:08.707131 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 519/1048] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:08 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1461 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:09.210731 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-37adcc20-f957-457f-94bb-f32dbd16fc1e req-43c87652-f7c4-4860-8d13-0e19891bfe42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1df560e-95ad-4efd-9e8e-9252fe66397b", "name": "network-vif-deleted", "tag": "28779c04-5b79-4148-9856-ace8639fe9d0"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:09.218327 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:09.219115 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:09.222453 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:09.224930 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-37adcc20-f957-457f-94bb-f32dbd16fc1e req-43c87652-f7c4-4860-8d13-0e19891bfe42 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:09.225618 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-37adcc20-f957-457f-94bb-f32dbd16fc1e req-43c87652-f7c4-4860-8d13-0e19891bfe42 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:09.226224 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:09.226438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-37adcc20-f957-457f-94bb-f32dbd16fc1e req-43c87652-f7c4-4860-8d13-0e19891bfe42 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:09.226766 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:09.227252 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:09.228111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:09.228568 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:09.229194 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:09.240935 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-37adcc20-f957-457f-94bb-f32dbd16fc1e req-43c87652-f7c4-4860-8d13-0e19891bfe42 service nova] Creating event network-vif-deleted:28779c04-5b79-4148-9856-ace8639fe9d0 for instance d1df560e-95ad-4efd-9e8e-9252fe66397b on hv-cinder-85221 Sep 01 17:44:09.245183 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] HTTP exception thrown: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.246936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-37adcc20-f957-457f-94bb-f32dbd16fc1e req-43c87652-f7c4-4860-8d13-0e19891bfe42 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039924 Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Request method failure captured: Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: DELETE /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 HTTP/1.1 Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxma2FgyTsC6cDAwx1Qenr9c2MeYVTECG0FZEKOY2to7JExjBEtoKRvgnpLWxHxiFNn02km7iPeToINKKsoESJwZy3KvZEoKRIkfF3oa2dtKYRAGDkhBW-T5smj5JIwu7MeAshPgvJ7sYQsky_MguEXvxxoJNBppmU7DsA7rsgO4Iw Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:44:09.247562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_97796d8be4794e89a89965af17bb3fa9", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}] Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 26bf17f1fb8948008fed82f4ba33bf66 Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.249196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': 'b61004bf-b919-4848-8efa-ba83a2a8e633'} Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:09.250151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.251549 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.253228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Returning 404 to user: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:09.253228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cedba65d-5849-49a6-ae9f-ce1662fb6a6e tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "DELETE /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 404 len: 111 microversion: 2.20 time: 0.035166 Sep 01 17:44:09.253228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 520/1049] 10.222.0.102 () {60 vars in 1285 bytes} [Thu Sep 1 17:44:09 2022] DELETE /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:44:09.254112 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 530/1050] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:09.257680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:09.258347 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] [instance: b61004bf-b919-4848-8efa-ba83a2a8e633] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:09.264777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:09.265192 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:09.265660 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:09.266354 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:09.266807 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:09.267229 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:09.285779 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] HTTP exception thrown: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Request method failure captured: Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 HTTP/1.1 Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOxma2FgyTsC6cDAwx1Qenr9c2MeYVTECG0FZEKOY2to7JExjBEtoKRvgnpLWxHxiFNn02km7iPeToINKKsoESJwZy3KvZEoKRIkfF3oa2dtKYRAGDkhBW-T5smj5JIwu7MeAshPgvJ7sYQsky_MguEXvxxoJNBppmU7DsA7rsgO4Iw Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:44:09.287505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_97796d8be4794e89a89965af17bb3fa9", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/97796d8be4794e89a89965af17bb3fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/97796d8be4794e89a89965af17bb3fa9"}]}] Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 97796d8be4794e89a89965af17bb3fa9 Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1625884451 Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 26bf17f1fb8948008fed82f4ba33bf66 Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1625884451-project Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.289033 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': 'b61004bf-b919-4848-8efa-ba83a2a8e633'} Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:09.290255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. Sep 01 17:44:09.291453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:09.292566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] Returning 404 to user: Instance b61004bf-b919-4848-8efa-ba83a2a8e633 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:09.292566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-22f0f1fa-7f02-4cbb-867f-bc8e10320548 tempest-AttachVolumeShelveTestJSON-1625884451 tempest-AttachVolumeShelveTestJSON-1625884451-project] 10.222.0.102 "GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633" status: 404 len: 111 microversion: 2.20 time: 0.035622 Sep 01 17:44:09.292566 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 521/1051] 10.222.0.102 () {60 vars in 1282 bytes} [Thu Sep 1 17:44:09 2022] GET /compute/v2.1/servers/b61004bf-b919-4848-8efa-ba83a2a8e633 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:44:09.732811 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:09.733374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:09.740344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:09.741562 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:09.742011 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:09.742721 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:09.743178 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:09.743604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:09.778029 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:09.778299 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:09.781543 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:09.782216 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lazy-loading 'fault' on Instance uuid d1df560e-95ad-4efd-9e8e-9252fe66397b {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:44:09.831921 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:09.839864 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-817eb6e4-8c51-4887-972e-096b6e975ab3 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 200 len: 1233 microversion: 2.1 time: 0.111680 Sep 01 17:44:09.840426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 531/1052] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:09 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 1233 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:10.862497 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:10.863209 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: d1df560e-95ad-4efd-9e8e-9252fe66397b] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:10.869774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:10.870399 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:10.870818 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:10.871820 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:10.872424 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:10.874519 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:10.890587 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] HTTP exception thrown: Instance d1df560e-95ad-4efd-9e8e-9252fe66397b could not be found. Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Request method failure captured: Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b HTTP/1.1 Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOz6SiteVYGfythyB7NWby-1Tuyl3GQHRYmX3eA_o3S5CahmIU2mQKqPgdhLUOiqfhGo674xAZuQx-LlLgrD1rFnP9cGmEyOBqVO4nfDJBocHA3ETEG9XSUv4hwGt7OeoqEw9NzYSpGjFa6hn1Av5nbBwF79ziA9xhccTsDZPXuljoA Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:44:10.892143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_2cc300abf09e4bb3857336df552286e2", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}] Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 8f59383e2f6c4da8b683d718f62d25fb Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance d1df560e-95ad-4efd-9e8e-9252fe66397b could not be found. Sep 01 17:44:10.893614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': 'd1df560e-95ad-4efd-9e8e-9252fe66397b'} Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1df560e-95ad-4efd-9e8e-9252fe66397b could not be found. Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:10.894389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1df560e-95ad-4efd-9e8e-9252fe66397b could not be found. Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1df560e-95ad-4efd-9e8e-9252fe66397b could not be found. Sep 01 17:44:10.895686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:10.896792 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Returning 404 to user: Instance d1df560e-95ad-4efd-9e8e-9252fe66397b could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:10.896792 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-173c2d9d-7254-4d55-88d7-25f0e753d7ca tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b" status: 404 len: 111 microversion: 2.1 time: 0.035083 Sep 01 17:44:10.897801 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 522/1053] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:10 2022] GET /compute/v2.1/servers/d1df560e-95ad-4efd-9e8e-9252fe66397b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:14.351434 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:14.352698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-74da0b91-1166-40ed-afe0-a4d92ea3ed32 req-32458647-2802-4e70-8cc2-69054ed3f8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac61b88-58ea-45b4-bb8a-9e16713010b2", "tag": "96c5512d-5f40-4852-aa83-f665f3064d76"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:14.353449 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:14.366023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-74da0b91-1166-40ed-afe0-a4d92ea3ed32 req-32458647-2802-4e70-8cc2-69054ed3f8d1 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:14.366553 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-74da0b91-1166-40ed-afe0-a4d92ea3ed32 req-32458647-2802-4e70-8cc2-69054ed3f8d1 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:14.367005 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-74da0b91-1166-40ed-afe0-a4d92ea3ed32 req-32458647-2802-4e70-8cc2-69054ed3f8d1 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:14.371210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:14.371686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:14.373193 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:14.375910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:14.376571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:14.378303 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:14.381417 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-74da0b91-1166-40ed-afe0-a4d92ea3ed32 req-32458647-2802-4e70-8cc2-69054ed3f8d1 service nova] Creating event network-changed:96c5512d-5f40-4852-aa83-f665f3064d76 for instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 on hv-cinder-85221 Sep 01 17:44:14.394463 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-74da0b91-1166-40ed-afe0-a4d92ea3ed32 req-32458647-2802-4e70-8cc2-69054ed3f8d1 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041106 Sep 01 17:44:14.395863 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 523/1054] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:14.410938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:44:14.513680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-610127a9-c85f-48be-8e2e-6476b09a2178 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "DELETE /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 204 len: 0 microversion: 2.1 time: 0.168013 Sep 01 17:44:14.514762 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 532/1055] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:44:14 2022] DELETE /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:44:14.525378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:14.528625 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:14.536276 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:14.537059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:14.537600 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:14.538410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:14.538915 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:14.539576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:14.867913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:14.881560 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f58b02b7-109e-4b2c-862b-3291ed4b602c tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1579 microversion: 2.1 time: 0.360394 Sep 01 17:44:14.882143 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 524/1056] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:14 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1579 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:15.905507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:15.906361 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:15.921106 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:15.922437 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:15.923387 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:15.925032 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:15.926046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:15.926776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:16.110903 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:16.120419 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7beb9e75-7623-4a5d-a189-72811273d274 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1460 microversion: 2.1 time: 0.219976 Sep 01 17:44:16.121001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 533/1057] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:15 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1460 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:16.512511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-e7d8cd0a-e1c6-4a99-be57-a974c1a7d7f9 req-7cba66f1-9395-451d-856b-6c57e590ea96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac61b88-58ea-45b4-bb8a-9e16713010b2", "name": "network-vif-deleted", "tag": "96c5512d-5f40-4852-aa83-f665f3064d76"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:16.532663 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-e7d8cd0a-e1c6-4a99-be57-a974c1a7d7f9 req-7cba66f1-9395-451d-856b-6c57e590ea96 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:16.533248 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-e7d8cd0a-e1c6-4a99-be57-a974c1a7d7f9 req-7cba66f1-9395-451d-856b-6c57e590ea96 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:16.533640 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-e7d8cd0a-e1c6-4a99-be57-a974c1a7d7f9 req-7cba66f1-9395-451d-856b-6c57e590ea96 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:16.551557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-e7d8cd0a-e1c6-4a99-be57-a974c1a7d7f9 req-7cba66f1-9395-451d-856b-6c57e590ea96 service nova] Creating event network-vif-deleted:96c5512d-5f40-4852-aa83-f665f3064d76 for instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 on hv-cinder-85221 Sep 01 17:44:16.559007 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-e7d8cd0a-e1c6-4a99-be57-a974c1a7d7f9 req-7cba66f1-9395-451d-856b-6c57e590ea96 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052851 Sep 01 17:44:16.560438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 525/1058] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:17.144691 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:17.145279 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:17.154419 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:17.154907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:17.155336 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:17.159184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:17.159941 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:17.162964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:17.247057 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f59383e2f6c4da8b683d718f62d25fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc300abf09e4bb3857336df552286e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:17.256862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d9b8595b-dab2-4de4-a69b-3d9102e792c7 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 200 len: 1228 microversion: 2.1 time: 0.117846 Sep 01 17:44:17.257825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 534/1059] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:17 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 1228 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:18.280131 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:18.281726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: 5ac61b88-58ea-45b4-bb8a-9e16713010b2] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:18.290530 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:18.291463 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:18.292116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:18.293035 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:18.302177 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:18.303194 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:18.334352 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] HTTP exception thrown: Instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 could not be found. Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Request method failure captured: Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 HTTP/1.1 Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOz6SiteVYGfythyB7NWby-1Tuyl3GQHRYmX3eA_o3S5CahmIU2mQKqPgdhLUOiqfhGo674xAZuQx-LlLgrD1rFnP9cGmEyOBqVO4nfDJBocHA3ETEG9XSUv4hwGt7OeoqEw9NzYSpGjFa6hn1Av5nbBwF79ziA9xhccTsDZPXuljoA Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:44:18.336873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_2cc300abf09e4bb3857336df552286e2", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}] Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 8f59383e2f6c4da8b683d718f62d25fb Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 could not be found. Sep 01 17:44:18.338453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '5ac61b88-58ea-45b4-bb8a-9e16713010b2'} Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 could not be found. Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:18.339230 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 could not be found. Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 could not be found. Sep 01 17:44:18.340517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.342745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Returning 404 to user: Instance 5ac61b88-58ea-45b4-bb8a-9e16713010b2 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:18.343925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2bcca2a8-3482-4966-8d11-fcb3b5d4c340 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2" status: 404 len: 111 microversion: 2.1 time: 0.068883 Sep 01 17:44:18.344522 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 526/1060] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:18 2022] GET /compute/v2.1/servers/5ac61b88-58ea-45b4-bb8a-9e16713010b2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:18.872374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:18.872946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:18.880382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:18.880869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:18.881867 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:18.882576 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:18.883074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:18.883683 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:18.898599 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] HTTP exception thrown: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Request method failure captured: Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: DELETE /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa HTTP/1.1 Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEOz6SiteVYGfythyB7NWby-1Tuyl3GQHRYmX3eA_o3S5CahmIU2mQKqPgdhLUOiqfhGo674xAZuQx-LlLgrD1rFnP9cGmEyOBqVO4nfDJBocHA3ETEG9XSUv4hwGt7OeoqEw9NzYSpGjFa6hn1Av5nbBwF79ziA9xhccTsDZPXuljoA Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:44:18.900294 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_2cc300abf09e4bb3857336df552286e2", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}] Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: 8f59383e2f6c4da8b683d718f62d25fb Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.901897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'bbbe128c-ca7d-41f4-9013-2110694968fa'} Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:18.902799 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.904284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.905749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Returning 404 to user: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:18.905749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-26f680d2-0b58-4efb-860d-a7cb2a7ed5c8 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "DELETE /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 404 len: 111 microversion: 2.1 time: 0.033957 Sep 01 17:44:18.911094 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:18.911738 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] [instance: bbbe128c-ca7d-41f4-9013-2110694968fa] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:18.916375 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 535/1061] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:44:18 2022] DELETE /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:18.918387 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:18.918875 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:18.919309 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:18.920010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:18.920767 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:18.921208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:18.938270 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] HTTP exception thrown: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Request method failure captured: Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa HTTP/1.1 Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEOz6SiteVYGfythyB7NWby-1Tuyl3GQHRYmX3eA_o3S5CahmIU2mQKqPgdhLUOiqfhGo674xAZuQx-LlLgrD1rFnP9cGmEyOBqVO4nfDJBocHA3ETEG9XSUv4hwGt7OeoqEw9NzYSpGjFa6hn1Av5nbBwF79ziA9xhccTsDZPXuljoA Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:44:18.939879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_2cc300abf09e4bb3857336df552286e2", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/2cc300abf09e4bb3857336df552286e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/2cc300abf09e4bb3857336df552286e2"}]}] Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 2cc300abf09e4bb3857336df552286e2 Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362260287 Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: 8f59383e2f6c4da8b683d718f62d25fb Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-TestVolumeBootPattern-1362260287-project Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.941264 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': 'bbbe128c-ca7d-41f4-9013-2110694968fa'} Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:44:18.942044 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. Sep 01 17:44:18.943265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:44:18.944366 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Returning 404 to user: Instance bbbe128c-ca7d-41f4-9013-2110694968fa could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:44:18.944366 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-58246d11-7da6-4cd6-b808-d0fe58100e7e tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa" status: 404 len: 111 microversion: 2.1 time: 0.034316 Sep 01 17:44:18.944366 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 527/1062] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:18 2022] GET /compute/v2.1/servers/bbbe128c-ca7d-41f4-9013-2110694968fa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:44:19.504365 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c3d0f545-6107-4fa0-87ca-5b1070d843d9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: .version_select at 0x7fb856a03280>, body: {"keypair": {"name": "tempest-keypair-865008367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc8uRURNJaZ+JkrSOdRA6lmytOJvJIg/rHeRQLQ1Vqp6hcKo1Mc1+qlKZUaZVWRUZyfzYBVNPTzMBRjGw7PPRGK+GN/bzTheuMIY4IE3a5tnt63YP9WE0+Ua/s9YJ81kA=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:19.525169 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-c3d0f545-6107-4fa0-87ca-5b1070d843d9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for project de5f40e77a914f919f5bb15d11181f65. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:44:19.529296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-c3d0f545-6107-4fa0-87ca-5b1070d843d9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for user e7660433575a4daaaed075a6c8934934 and project de5f40e77a914f919f5bb15d11181f65. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:44:19.557638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c3d0f545-6107-4fa0-87ca-5b1070d843d9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.245929 Sep 01 17:44:19.558466 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 536/1063] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:44:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:44:20.302115 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4bc1bf50-231c-4eb8-a90e-8f568c5f8210 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] Calling method '.version_select at 0x7fb85656d940>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:20.336493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4bc1bf50-231c-4eb8-a90e-8f568c5f8210 tempest-TestVolumeBootPattern-1362260287 tempest-TestVolumeBootPattern-1362260287-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-580347756" status: 202 len: 0 microversion: 2.1 time: 0.037567 Sep 01 17:44:20.340985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 528/1064] 10.222.0.102 () {58 vars in 1265 bytes} [Thu Sep 1 17:44:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-580347756 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:44:20.931056 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1378087837", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "071929ca-5336-44fd-8aa0-3c7ff215fc5e"}], "security_groups": [{"name": "tempest-securitygroup--71540199"}], "key_name": "tempest-keypair-865008367", "user_data": "}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:21.152863 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.network.neutron [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] validate_networks() for [('071929ca-5336-44fd-8aa0-3c7ff215fc5e', None, None, None, None, None)] {{(pid=121744) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:44:21.819668 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Flavor limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:44:21.820095 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Image limits 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:44:21.820569 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Flavor pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:44:21.820975 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Image pref 0:0:0 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:44:21.821421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.virt.hardware [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:44:21.834137 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:21.834782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:21.835044 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:21.835775 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:21.836228 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:21.836652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:21.879801 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for project de5f40e77a914f919f5bb15d11181f65. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:44:21.886712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for user e7660433575a4daaaed075a6c8934934 and project de5f40e77a914f919f5bb15d11181f65. Resources: {'cores', 'instances', 'ram'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:44:21.909281 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Going to run 1 instances... {{(pid=121744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:44:21.912644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:44:21.967672 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b76b7724-b6e2-438e-be6c-5f3f66015878 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.041092 Sep 01 17:44:21.969384 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 537/1065] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:44:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:44:21.980011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-41c916e3-ab1d-47c8-bced-1c4fe02ba29e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:21.981301 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-41c916e3-ab1d-47c8-bced-1c4fe02ba29e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:22.055348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-41c916e3-ab1d-47c8-bced-1c4fe02ba29e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:22.064506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-41c916e3-ab1d-47c8-bced-1c4fe02ba29e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1245 microversion: 2.1 time: 0.088247 Sep 01 17:44:22.065681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 529/1066] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:21 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:23.085507 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:23.086138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:23.105159 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:23.105697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:23.106144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:23.106874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:23.107337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:23.107768 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:23.241831 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:23.254419 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-653bf34f-ac00-4bd2-8ce0-a65df0b2f289 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1297 microversion: 2.1 time: 0.173285 Sep 01 17:44:23.258105 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 538/1067] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:23 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1297 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:24.282410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:24.282410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:24.309261 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:24.309784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:24.310224 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:24.310934 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:24.311389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:24.311810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:24.698750 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:24.717357 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c439ff4f-718b-4c78-8035-5a4d5e3bb81b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1303 microversion: 2.1 time: 0.440696 Sep 01 17:44:24.720027 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 530/1068] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:24 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1303 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:25.694344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-44bfcc3d-87c1-41dd-ad8d-9e634093214a req-d7cad00e-59b0-45ec-80c1-f5828231cb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0120f498-e71f-4898-aef0-57306acb3599", "tag": "a294c79e-53ea-4036-87bb-8446552b1661"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:25.705410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-44bfcc3d-87c1-41dd-ad8d-9e634093214a req-d7cad00e-59b0-45ec-80c1-f5828231cb39 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:25.706264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-44bfcc3d-87c1-41dd-ad8d-9e634093214a req-d7cad00e-59b0-45ec-80c1-f5828231cb39 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:25.706696 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-44bfcc3d-87c1-41dd-ad8d-9e634093214a req-d7cad00e-59b0-45ec-80c1-f5828231cb39 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:25.718213 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-44bfcc3d-87c1-41dd-ad8d-9e634093214a req-d7cad00e-59b0-45ec-80c1-f5828231cb39 service nova] Creating event network-changed:a294c79e-53ea-4036-87bb-8446552b1661 for instance 0120f498-e71f-4898-aef0-57306acb3599 on hv-cinder-85221 Sep 01 17:44:25.724877 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-44bfcc3d-87c1-41dd-ad8d-9e634093214a req-d7cad00e-59b0-45ec-80c1-f5828231cb39 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033722 Sep 01 17:44:25.727817 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 539/1069] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:25.745636 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:25.747320 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:25.753623 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:25.754141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:25.754559 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:25.755251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:25.755701 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:25.756268 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:25.896140 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:25.904010 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-eb9fef94-f8b3-4079-8dc6-feca61e9e0f7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.162354 Sep 01 17:44:25.904583 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 531/1070] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:25 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:26.925736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:26.926441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:26.932659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:26.933143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:26.933606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:26.934302 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:26.934757 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:26.935181 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:27.137917 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:27.146710 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-4400b822-f17a-40ed-904c-2143b75f7586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.225752 Sep 01 17:44:27.147493 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 540/1071] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:26 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:28.167320 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:28.168013 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:28.175284 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:28.175832 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:28.176325 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:28.177080 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:28.177658 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:28.178151 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:28.310463 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:28.318236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ec2ea1ef-72fd-4fa4-85de-fc79b0787654 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.154930 Sep 01 17:44:28.318874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 532/1072] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:28 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:29.339286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:29.339911 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:29.346377 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:29.346861 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:29.347299 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:29.348021 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:29.348475 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:29.349152 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:29.479663 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:29.487859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c981de54-3aff-4547-a885-3e840243716d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.152478 Sep 01 17:44:29.488426 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 541/1073] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:29 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:30.508726 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:30.509266 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:30.515671 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:30.516150 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:30.516580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:30.517261 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:30.517738 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:30.518155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:30.647090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:30.654747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-92b7d6ac-f6f2-44d4-8df0-e2e613708171 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.149974 Sep 01 17:44:30.655309 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 533/1074] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:30 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:31.675309 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:31.676142 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:31.683208 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:31.683688 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:31.684121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:31.684816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:31.685298 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:31.685738 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:31.819690 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:31.828000 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-20d7142e-8d7b-4a78-a3b4-86e0dc8890d5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.156409 Sep 01 17:44:31.828588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 542/1075] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:31 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:32.848023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:32.848647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:32.851463 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:32.858534 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:32.859037 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:32.859472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:32.861556 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:32.862211 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:32.862662 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:32.996375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:33.004688 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-481d844c-2f92-4c30-b573-51eccd4727bc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.159932 Sep 01 17:44:33.005251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 534/1076] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:32 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:34.025241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:34.025875 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:34.027857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:34.028541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=10 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:34.036346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:34.036834 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:34.037267 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:34.037992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:34.038442 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:34.038864 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:34.176569 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:34.184185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-10852dcf-23ae-4325-a6e0-2fa212e39a4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.162845 Sep 01 17:44:34.184746 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 543/1077] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:34 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:35.204548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:35.205208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:35.212323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:35.212800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:35.213250 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:35.213961 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:35.214408 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:35.214826 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:35.345336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:35.354156 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2a4ac660-3905-4a5a-8c85-167ada4238d8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.153510 Sep 01 17:44:35.354892 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 535/1078] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:35 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:44:36.375854 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:36.376466 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:36.384186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:36.384693 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:36.385175 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:36.385880 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:36.386335 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:36.386765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:36.389465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:36.517410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:36.525283 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-94b611c0-5ffe-42b9-976c-09fdd4a368a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.153283 Sep 01 17:44:36.525878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 544/1079] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:36 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:37.545505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:37.546101 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:37.553163 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:37.553667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:37.554095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:37.554779 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:37.555226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:37.555645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:37.685618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:37.693947 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4d2b9d35-ce57-44bb-9352-0f236e97e412 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.152397 Sep 01 17:44:37.694526 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 536/1080] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:37 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:38.714210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:38.714860 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:38.721411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:38.721898 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:38.722387 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:38.723028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:38.723483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:38.723905 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:38.855648 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:38.863394 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-90bd9bf1-ffff-47b5-88fd-07808501f9e6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.153155 Sep 01 17:44:38.864714 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 545/1081] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:38 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:39.164525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-f64bc273-f197-4d74-ba96-ec331f7bc967 req-752ac7e8-c587-4c98-b728-361ce74ae1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0120f498-e71f-4898-aef0-57306acb3599", "name": "network-vif-plugged", "status": "completed", "tag": "a294c79e-53ea-4036-87bb-8446552b1661"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:39.170743 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.176755 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-f64bc273-f197-4d74-ba96-ec331f7bc967 req-752ac7e8-c587-4c98-b728-361ce74ae1f9 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:39.177270 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-f64bc273-f197-4d74-ba96-ec331f7bc967 req-752ac7e8-c587-4c98-b728-361ce74ae1f9 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:39.177729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-f64bc273-f197-4d74-ba96-ec331f7bc967 req-752ac7e8-c587-4c98-b728-361ce74ae1f9 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:39.182350 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=68 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.192185 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-f64bc273-f197-4d74-ba96-ec331f7bc967 req-752ac7e8-c587-4c98-b728-361ce74ae1f9 service nova] Creating event network-vif-plugged:a294c79e-53ea-4036-87bb-8446552b1661 for instance 0120f498-e71f-4898-aef0-57306acb3599 on hv-cinder-85221 Sep 01 17:44:39.197665 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-f64bc273-f197-4d74-ba96-ec331f7bc967 req-752ac7e8-c587-4c98-b728-361ce74ae1f9 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037038 Sep 01 17:44:39.198305 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 537/1082] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:39.885403 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:39.885938 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:39.888265 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:44:39.893825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:39.894316 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:39.894810 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:39.896065 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:39.896522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:39.896967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:40.023210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:40.030930 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e2c3cd22-088b-4667-a150-cbdbc48d2bed tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.150253 Sep 01 17:44:40.031498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 546/1083] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:39 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:41.053092 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:41.053856 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:41.060136 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:41.060618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:41.061063 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:41.061814 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:41.062267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:41.062687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:41.192294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:41.200041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-cefad840-c349-4081-bce8-dbb314bc6ac1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.151822 Sep 01 17:44:41.200604 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 538/1084] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:41 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:42.221197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:42.221776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:42.228564 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:42.229041 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:42.230147 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:42.230832 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:42.231284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:42.231702 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:42.359582 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:42.367818 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-712a9b49-8e93-4d58-bb71-43db15d747d6 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.150582 Sep 01 17:44:42.368369 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 547/1085] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:42 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:43.388517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:43.389124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:43.395612 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:43.396093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:43.396521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:43.397200 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:43.397679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:43.398098 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:43.528058 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:43.535689 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-97de54f8-0322-4e96-8ee6-6924517df5c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.151078 Sep 01 17:44:43.536249 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 539/1086] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:43 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:44.555983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:44.556634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:44.563160 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:44.563636 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:44.564058 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:44.564734 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:44.565184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:44.565624 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:44.928865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:44.936513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c0c599e6-e7ce-47b0-add1-fa0f22dca3ba tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1369 microversion: 2.1 time: 0.384433 Sep 01 17:44:44.937065 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 548/1087] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:44 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1369 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:45.957872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:45.959097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:45.965513 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:45.965992 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:45.966417 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:45.967099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:45.967548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:45.967972 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:46.093657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:44:46.102345 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d33b4a32-bee5-407d-9a46-74e42c332586 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1558 microversion: 2.1 time: 0.148434 Sep 01 17:44:46.102940 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 540/1088] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:44:45 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:44:46.122854 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-bf64a9f4-b570-4c64-a095-ab0a7458cf07 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:44:46.123334 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-bf64a9f4-b570-4c64-a095-ab0a7458cf07 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:44:46.129964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bf64a9f4-b570-4c64-a095-ab0a7458cf07 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:46.130443 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bf64a9f4-b570-4c64-a095-ab0a7458cf07 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:46.130865 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bf64a9f4-b570-4c64-a095-ab0a7458cf07 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:46.131572 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bf64a9f4-b570-4c64-a095-ab0a7458cf07 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:46.132018 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bf64a9f4-b570-4c64-a095-ab0a7458cf07 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:46.132431 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-bf64a9f4-b570-4c64-a095-ab0a7458cf07 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:46.210656 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-bf64a9f4-b570-4c64-a095-ab0a7458cf07 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091633 Sep 01 17:44:46.211279 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 549/1089] 10.222.0.102 () {58 vars in 1280 bytes} [Thu Sep 1 17:44:46 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:44:47.368375 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-90a2e461-ebc3-4536-a38c-5f618d0cbfcb req-20b5c626-0a4e-4019-a13c-d9e0c636aaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0120f498-e71f-4898-aef0-57306acb3599", "tag": "a294c79e-53ea-4036-87bb-8446552b1661"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:44:47.377670 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-90a2e461-ebc3-4536-a38c-5f618d0cbfcb req-20b5c626-0a4e-4019-a13c-d9e0c636aaf3 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:44:47.378138 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-90a2e461-ebc3-4536-a38c-5f618d0cbfcb req-20b5c626-0a4e-4019-a13c-d9e0c636aaf3 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:44:47.378556 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-90a2e461-ebc3-4536-a38c-5f618d0cbfcb req-20b5c626-0a4e-4019-a13c-d9e0c636aaf3 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:44:47.390068 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-90a2e461-ebc3-4536-a38c-5f618d0cbfcb req-20b5c626-0a4e-4019-a13c-d9e0c636aaf3 service nova] Creating event network-changed:a294c79e-53ea-4036-87bb-8446552b1661 for instance 0120f498-e71f-4898-aef0-57306acb3599 on hv-cinder-85221 Sep 01 17:44:47.395203 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-90a2e461-ebc3-4536-a38c-5f618d0cbfcb req-20b5c626-0a4e-4019-a13c-d9e0c636aaf3 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206228 Sep 01 17:44:47.395906 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 541/1090] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:32.373197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 17:46:32.374346 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Thu Sep 1 17:46:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/ips (ip 10.222.0.102) !!! Sep 01 17:46:32.375166 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=7 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:32.376117 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=33 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:32.382628 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b9ab47ef-0a18-4237-a94d-3909192fd59e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:32.383416 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b9ab47ef-0a18-4237-a94d-3909192fd59e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:32.394178 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b9ab47ef-0a18-4237-a94d-3909192fd59e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:32.395461 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b9ab47ef-0a18-4237-a94d-3909192fd59e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:32.396078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b9ab47ef-0a18-4237-a94d-3909192fd59e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:32.397297 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b9ab47ef-0a18-4237-a94d-3909192fd59e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:32.398513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b9ab47ef-0a18-4237-a94d-3909192fd59e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:32.399118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b9ab47ef-0a18-4237-a94d-3909192fd59e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:32.427385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b9ab47ef-0a18-4237-a94d-3909192fd59e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/ips" status: 200 len: 149 microversion: 2.1 time: 0.057417 Sep 01 17:46:32.428775 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 550/1091] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:46:32 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/ips => generated 149 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:33.999587 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 17:46:34.000122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Thu Sep 1 17:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments (ip 10.222.0.102) !!! Sep 01 17:46:34.001668 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=9 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:34.002615 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=21 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:34.013051 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1fa6ca2d-5243-4ced-ab30-1d71cd2ab2a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "245315a9-907e-4888-b5d0-565009cfc7c3"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:34.016224 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1fa6ca2d-5243-4ced-ab30-1d71cd2ab2a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:34.024910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fa6ca2d-5243-4ced-ab30-1d71cd2ab2a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:34.025504 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fa6ca2d-5243-4ced-ab30-1d71cd2ab2a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:34.026186 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fa6ca2d-5243-4ced-ab30-1d71cd2ab2a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:34.026881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fa6ca2d-5243-4ced-ab30-1d71cd2ab2a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:34.027503 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fa6ca2d-5243-4ced-ab30-1d71cd2ab2a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:34.027921 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1fa6ca2d-5243-4ced-ab30-1d71cd2ab2a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:34.446768 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fcc766d6-0627-4978-a769-154e71c353f9 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Action: 'create', calling method: .version_select at 0x7fb85681c1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2036457186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhq9FtBnkdMSh9rUuJvk4sU/IC3JT+IU5t/ybEINWG9ii2+phfabTugtjCdfCbUpbuPt/YHMDqtcCIowi7inY1WdHd/Rp3NUvKKXZe/OfObCU1VWHRhPsbTy6kQW65nZw=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:34.465342 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-fcc766d6-0627-4978-a769-154e71c353f9 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Getting quotas for project 85538f245b5b4f4d8799169e2857278d. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:46:34.471374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-fcc766d6-0627-4978-a769-154e71c353f9 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Getting quotas for user cfa2b12905ac4709947cbeb9db264f33 and project 85538f245b5b4f4d8799169e2857278d. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:46:34.510038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fcc766d6-0627-4978-a769-154e71c353f9 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.209471 Sep 01 17:46:34.511231 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 551/1092] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:46:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:34.614660 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1fa6ca2d-5243-4ced-ab30-1d71cd2ab2a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.616785 Sep 01 17:46:34.615481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 542/1093] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:46:33 2022] POST /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:42.210769 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-25f81ff5-b7d1-49e8-8ac6-f3ca59ee6d9b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: .version_select at 0x7fb856835ca0>, body: {"keypair": {"name": "tempest-keypair-203804241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLtPmJJsq40kEG33X4aTzZyXhlEh+jsgZTyY6OJJfwtVezLu9nP4hsjHmQ4l9ZxUHRh8rHMJeQ82Njc7bQUWzUPP71uzBD8wyz9gfdYTBc1u5mDnRYtoeS7Boh5Zu0PgQ=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:42.226841 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-25f81ff5-b7d1-49e8-8ac6-f3ca59ee6d9b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for project de5f40e77a914f919f5bb15d11181f65. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:46:42.230757 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-25f81ff5-b7d1-49e8-8ac6-f3ca59ee6d9b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for user e7660433575a4daaaed075a6c8934934 and project de5f40e77a914f919f5bb15d11181f65. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:46:42.254759 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-25f81ff5-b7d1-49e8-8ac6-f3ca59ee6d9b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048272 Sep 01 17:46:42.255347 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 552/1094] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:46:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:43.534984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1854351913", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "071929ca-5336-44fd-8aa0-3c7ff215fc5e"}], "security_groups": [{"name": "tempest-securitygroup--82818266"}], "key_name": "tempest-keypair-203804241", "user_data": "}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:43.640735 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] validate_networks() for [('071929ca-5336-44fd-8aa0-3c7ff215fc5e', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:46:44.131495 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:46:44.131914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:46:44.132382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:46:44.132787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:46:44.133194 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:46:44.142560 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:44.143037 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:44.143467 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:44.144182 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:44.144636 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:44.145052 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:44.162292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for project de5f40e77a914f919f5bb15d11181f65. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:46:44.166258 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for user e7660433575a4daaaed075a6c8934934 and project de5f40e77a914f919f5bb15d11181f65. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:46:44.177173 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:46:44.179629 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:46:44.230276 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7f13bafb-3aed-46b0-a81c-d965f53eeca7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.698825 Sep 01 17:46:44.230276 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 543/1095] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:46:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:46:44.238685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=4 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:44.243488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f40930d1-2d18-4e36-81e7-7da3a9880897 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:44.244102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f40930d1-2d18-4e36-81e7-7da3a9880897 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:44.356519 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f40930d1-2d18-4e36-81e7-7da3a9880897 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:44.364050 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f40930d1-2d18-4e36-81e7-7da3a9880897 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1245 microversion: 2.1 time: 0.126145 Sep 01 17:46:44.364603 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 553/1096] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:44 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:45.388125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:45.388722 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:45.397278 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:45.397995 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:45.398622 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:45.399308 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:45.399757 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:45.400955 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:45.489409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:45.497611 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-381a5a79-2c3a-439d-8ef9-6b22f37c99d4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1305 microversion: 2.1 time: 0.115412 Sep 01 17:46:45.498669 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 544/1097] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:45 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:46.518212 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:46.518833 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:46.525596 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:46.526152 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:46.526686 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:46.527575 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:46.528056 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:46.528486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:46.669654 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:46.677870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9ea39568-6140-4518-8a3c-08479fb0212b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1369 microversion: 2.1 time: 0.163487 Sep 01 17:46:46.678467 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 554/1098] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:46 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:47.136913 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-3196db90-a09c-4c50-ab65-32b8931a711a req-4b4369f8-7d3c-4146-9a71-a0b9df5424e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd764166-44f4-4ee9-831d-dc94f3f62093", "tag": "980bf536-0147-4722-b22a-bfe2f4711b89"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:47.148456 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-3196db90-a09c-4c50-ab65-32b8931a711a req-4b4369f8-7d3c-4146-9a71-a0b9df5424e6 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:47.149620 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-3196db90-a09c-4c50-ab65-32b8931a711a req-4b4369f8-7d3c-4146-9a71-a0b9df5424e6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:47.150149 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-3196db90-a09c-4c50-ab65-32b8931a711a req-4b4369f8-7d3c-4146-9a71-a0b9df5424e6 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:47.165460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-3196db90-a09c-4c50-ab65-32b8931a711a req-4b4369f8-7d3c-4146-9a71-a0b9df5424e6 service nova] Creating event network-changed:980bf536-0147-4722-b22a-bfe2f4711b89 for instance dd764166-44f4-4ee9-831d-dc94f3f62093 on hv-cinder-85221 Sep 01 17:46:47.171326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-3196db90-a09c-4c50-ab65-32b8931a711a req-4b4369f8-7d3c-4146-9a71-a0b9df5424e6 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038611 Sep 01 17:46:47.171933 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 545/1099] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:47.698640 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:47.699404 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:47.706961 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:47.707452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:47.707886 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:47.708594 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:47.709041 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:47.709508 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:47.847121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:47.855342 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3038af08-1a62-4fbe-9b58-7147aee22281 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1369 microversion: 2.1 time: 0.160597 Sep 01 17:46:47.855940 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 555/1100] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:47 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:48.876797 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:48.877535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:48.884106 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:48.884590 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:48.885024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:48.885737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:48.887645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:48.887645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:49.018209 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:49.025839 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-d56f7796-bdfc-4830-90d9-4aefcb93c57c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1369 microversion: 2.1 time: 0.153326 Sep 01 17:46:49.026397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 546/1101] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:48 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:50.047444 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:50.048058 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:50.054477 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:50.054962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:50.055398 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:50.056090 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:50.056544 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:50.056967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:50.183857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:50.191582 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ece2b4f7-89f0-459b-9b63-c6758188acc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1369 microversion: 2.1 time: 0.148779 Sep 01 17:46:50.192137 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 556/1102] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:50 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:51.214162 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:51.214776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:51.221918 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:51.222394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:51.222829 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:51.223514 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:51.223962 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:51.224382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:51.359925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:51.368277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1063d427-c10c-47e0-9aed-333c9e89ba4f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1369 microversion: 2.1 time: 0.160394 Sep 01 17:46:51.368900 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 547/1103] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:51 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:52.389501 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:52.390358 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:52.397023 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:52.397549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:52.397991 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:52.398689 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:52.399144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:52.399570 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:52.528611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:52.536972 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-68d70965-9e23-4c28-bd97-9c1a629017e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1369 microversion: 2.1 time: 0.151584 Sep 01 17:46:52.537565 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 557/1104] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:52 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:53.557488 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:53.558104 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:53.564575 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:53.565064 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:53.565645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:53.566334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:53.566787 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:53.567208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:53.703371 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:53.711069 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8db84a17-f429-4c75-985a-2ecca8b76217 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1369 microversion: 2.1 time: 0.157524 Sep 01 17:46:53.711635 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 548/1105] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:53 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:53.740869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-641cb38d-c4e1-48f9-960a-06e0f373f156 req-64b8d3dc-c140-47ab-a164-f366c45fd8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd764166-44f4-4ee9-831d-dc94f3f62093", "name": "network-vif-plugged", "status": "completed", "tag": "980bf536-0147-4722-b22a-bfe2f4711b89"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:53.752173 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-641cb38d-c4e1-48f9-960a-06e0f373f156 req-64b8d3dc-c140-47ab-a164-f366c45fd8d7 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:53.752649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-641cb38d-c4e1-48f9-960a-06e0f373f156 req-64b8d3dc-c140-47ab-a164-f366c45fd8d7 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:53.753073 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-641cb38d-c4e1-48f9-960a-06e0f373f156 req-64b8d3dc-c140-47ab-a164-f366c45fd8d7 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:53.764246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-641cb38d-c4e1-48f9-960a-06e0f373f156 req-64b8d3dc-c140-47ab-a164-f366c45fd8d7 service nova] Creating event network-vif-plugged:980bf536-0147-4722-b22a-bfe2f4711b89 for instance dd764166-44f4-4ee9-831d-dc94f3f62093 on hv-cinder-85221 Sep 01 17:46:53.769825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-641cb38d-c4e1-48f9-960a-06e0f373f156 req-64b8d3dc-c140-47ab-a164-f366c45fd8d7 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032636 Sep 01 17:46:53.770418 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 558/1106] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:54.732387 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:54.733005 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:54.735832 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:54.736638 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=6 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:54.743001 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:54.743473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:54.743896 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:54.744576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:54.745028 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:54.745474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:54.878514 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:54.889983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3cbed5fb-b5a5-4380-b837-cb7171f9771b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1369 microversion: 2.1 time: 0.161462 Sep 01 17:46:54.890707 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 549/1107] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:54 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:55.908143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=10 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:46:55.912829 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:55.913563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:55.920121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:55.920606 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:55.921041 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:55.921763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:55.922220 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:55.922644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:56.054666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:56.065908 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6c3db209-fcb1-44e4-8126-bf7d60c0154e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1369 microversion: 2.1 time: 0.158692 Sep 01 17:46:56.066482 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 559/1108] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:55 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:57.088516 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:57.089163 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:57.096229 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:57.096709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:57.097142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:57.097850 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:57.098326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:57.098745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:57.228759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:57.237421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-702257d1-64a1-4809-9077-5f5e720921e0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1558 microversion: 2.1 time: 0.152747 Sep 01 17:46:57.237988 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 550/1109] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:57 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:46:57.257254 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-aade1683-abd6-4b7d-b8f0-e09f0dbbdbc2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:57.257769 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-aade1683-abd6-4b7d-b8f0-e09f0dbbdbc2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:57.265185 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aade1683-abd6-4b7d-b8f0-e09f0dbbdbc2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:57.265694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aade1683-abd6-4b7d-b8f0-e09f0dbbdbc2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:57.266131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aade1683-abd6-4b7d-b8f0-e09f0dbbdbc2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:57.266821 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aade1683-abd6-4b7d-b8f0-e09f0dbbdbc2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:57.267273 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aade1683-abd6-4b7d-b8f0-e09f0dbbdbc2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:57.267694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aade1683-abd6-4b7d-b8f0-e09f0dbbdbc2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:57.346716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-aade1683-abd6-4b7d-b8f0-e09f0dbbdbc2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093380 Sep 01 17:46:57.347417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 560/1110] 10.222.0.102 () {58 vars in 1280 bytes} [Thu Sep 1 17:46:57 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:57.361260 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1460774752", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2036457186", "security_groups": [{"name": "tempest-secgroup-smoke-1722655110"}], "networks": [{"uuid": "d2d050ca-cfc1-46ea-a1ed-c76c7ff6812c"}], "block_device_mapping_v2": [{"uuid": "bb06e634-f6b3-43fd-87c4-cac93e914ccb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:57.532941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] validate_networks() for [('d2d050ca-cfc1-46ea-a1ed-c76c7ff6812c', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:46:58.259830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:46:58.260391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:46:58.260802 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:46:58.261208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:46:58.261646 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:46:58.271097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.271601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.272024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.272737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.273180 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.273617 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.290021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Getting quotas for project 85538f245b5b4f4d8799169e2857278d. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:46:58.293894 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Getting quotas for user cfa2b12905ac4709947cbeb9db264f33 and project 85538f245b5b4f4d8799169e2857278d. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:46:58.349817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:46:58.351912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb06e634-f6b3-43fd-87c4-cac93e914ccb',volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:46:58.488894 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e72fd6fb-b215-442d-bca4-62e1589bde72 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.131665 Sep 01 17:46:58.489736 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 551/1111] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:46:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:46:58.501031 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-1c04b91f-f286-4315-8d6b-82a74f9540b8 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:58.501754 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-1c04b91f-f286-4315-8d6b-82a74f9540b8 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:58.560465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-1c04b91f-f286-4315-8d6b-82a74f9540b8 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:58.571259 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-1c04b91f-f286-4315-8d6b-82a74f9540b8 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1092 microversion: 2.1 time: 0.074649 Sep 01 17:46:58.577657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 561/1112] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:58 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1092 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:46:58.577835 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-c96e20b1-bb50-43e3-b9a2-2435ff23a283 req-e1101fc0-3f1b-4a4f-8461-f341458d653b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd764166-44f4-4ee9-831d-dc94f3f62093", "tag": "980bf536-0147-4722-b22a-bfe2f4711b89"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:46:58.590804 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c96e20b1-bb50-43e3-b9a2-2435ff23a283 req-e1101fc0-3f1b-4a4f-8461-f341458d653b service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:58.591458 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c96e20b1-bb50-43e3-b9a2-2435ff23a283 req-e1101fc0-3f1b-4a4f-8461-f341458d653b service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:58.591885 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-c96e20b1-bb50-43e3-b9a2-2435ff23a283 req-e1101fc0-3f1b-4a4f-8461-f341458d653b service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:58.603428 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-c96e20b1-bb50-43e3-b9a2-2435ff23a283 req-e1101fc0-3f1b-4a4f-8461-f341458d653b service nova] Creating event network-changed:980bf536-0147-4722-b22a-bfe2f4711b89 for instance dd764166-44f4-4ee9-831d-dc94f3f62093 on hv-cinder-85221 Sep 01 17:46:58.609174 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-c96e20b1-bb50-43e3-b9a2-2435ff23a283 req-e1101fc0-3f1b-4a4f-8461-f341458d653b service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039443 Sep 01 17:46:58.609934 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 552/1113] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:46:59.592701 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:46:59.593901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:46:59.601296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:59.601875 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:59.602309 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:59.603001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:46:59.603446 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:46:59.603908 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:46:59.668130 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:46:59.676283 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-737fe032-414b-420d-9b78-1c9b723d6cf3 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1190 microversion: 2.1 time: 0.087500 Sep 01 17:46:59.677251 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 562/1114] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:46:59 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:00.698728 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:00.699963 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:00.708991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:00.709508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:00.709936 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:00.710800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:00.711250 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:00.711667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:00.936428 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:00.946292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-df713ab0-ad6c-4ac4-86ed-d0c6b3277a96 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.252623 Sep 01 17:47:00.947176 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 553/1115] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:00 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:01.388609 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-460108cf-50eb-4506-b49e-a43fba3e6929 req-be631157-fa3e-4ca1-bfd3-2c9be36073ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e90c424b-9038-47c2-aa24-4c6b3f88b49d", "tag": "2431c9fc-1050-4b52-9481-89b194766391"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:47:01.399396 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-460108cf-50eb-4506-b49e-a43fba3e6929 req-be631157-fa3e-4ca1-bfd3-2c9be36073ad service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:01.400160 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-460108cf-50eb-4506-b49e-a43fba3e6929 req-be631157-fa3e-4ca1-bfd3-2c9be36073ad service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:01.400594 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-460108cf-50eb-4506-b49e-a43fba3e6929 req-be631157-fa3e-4ca1-bfd3-2c9be36073ad service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:01.413107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-460108cf-50eb-4506-b49e-a43fba3e6929 req-be631157-fa3e-4ca1-bfd3-2c9be36073ad service nova] Creating event network-changed:2431c9fc-1050-4b52-9481-89b194766391 for instance e90c424b-9038-47c2-aa24-4c6b3f88b49d on hv-cinder-85221 Sep 01 17:47:01.417951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-460108cf-50eb-4506-b49e-a43fba3e6929 req-be631157-fa3e-4ca1-bfd3-2c9be36073ad service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033091 Sep 01 17:47:01.418547 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 563/1116] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:47:01.967323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:01.967946 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:01.974288 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:01.974757 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:01.975182 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:01.975857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:01.976301 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:01.976712 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:02.112012 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:02.119678 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6b4c7cb0-c53e-4816-a923-c3571c468c06 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.156174 Sep 01 17:47:02.120236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 554/1117] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:01 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:03.141139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:03.141870 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:03.143842 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:03.149323 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:03.149818 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:03.150253 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:03.150952 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:03.151410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:03.151836 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:03.282472 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:03.290184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-68054b4b-282a-4655-8335-1e915ea4c3c1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.153824 Sep 01 17:47:03.290749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 564/1118] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:03 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:04.311626 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:04.312238 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:04.314681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:04.320142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:04.320617 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:04.321066 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:04.321774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:04.322219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:04.322631 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:04.326064 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:04.454675 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:04.462432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-51549935-618f-45b1-8d4b-0058010c0cae tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.154677 Sep 01 17:47:04.463012 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 555/1119] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:04 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:05.483620 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:05.484256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:05.491030 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:05.491512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:05.491946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:05.492631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:05.493085 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:05.493553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:05.630245 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:05.637963 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-9762b6a7-5882-4229-8668-8d958f2bc892 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.158199 Sep 01 17:47:05.638522 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 565/1120] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:05 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:06.659496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:06.660088 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:06.666509 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:06.666988 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:06.667418 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:06.668102 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:06.668559 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:06.668983 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:06.796252 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:06.804298 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-af79f9b8-fd0c-4379-b7b3-9139d0eb52ee tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.149196 Sep 01 17:47:06.804858 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 556/1121] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:06 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:07.825292 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:07.825924 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:07.832520 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:07.833005 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:07.833481 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:07.834186 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:07.834640 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:07.835061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:07.967149 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:07.975395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-29b59586-d85e-4b8b-9398-04e795a06d24 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.153975 Sep 01 17:47:07.975967 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 566/1122] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:07 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:08.998035 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:08.998696 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:09.002496 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:09.003187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=6 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:09.008115 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:09.008603 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:09.009035 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:09.009759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:09.010215 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:09.010641 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:09.144896 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:09.152653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8eb7c776-0972-4df8-b388-1c6c9b4e6f66 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.159656 Sep 01 17:47:09.153248 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 557/1123] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:08 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:10.173458 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:10.174184 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:10.176172 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=2 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:10.182292 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:10.182872 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:10.183381 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:10.184155 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:10.184708 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:10.185221 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:10.325120 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:10.333665 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f6e372c8-2b92-49e6-aa4e-198adfbeb995 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.164138 Sep 01 17:47:10.334263 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 567/1124] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:10 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:47:11.356349 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:11.356956 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:11.364181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:11.364655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:11.365084 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:11.365792 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:11.366243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:11.366723 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:11.505564 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:11.513217 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-8be429be-9230-44f5-a40e-9969419cae63 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.160724 Sep 01 17:47:11.513796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 558/1125] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:11 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:47:11.902246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-375b044a-ac12-49f8-b3ca-8065729933be req-8706b904-e8cd-478e-a21b-857f22f06201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90c424b-9038-47c2-aa24-4c6b3f88b49d", "name": "network-vif-plugged", "status": "completed", "tag": "2431c9fc-1050-4b52-9481-89b194766391"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:47:11.912123 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-375b044a-ac12-49f8-b3ca-8065729933be req-8706b904-e8cd-478e-a21b-857f22f06201 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:11.912600 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-375b044a-ac12-49f8-b3ca-8065729933be req-8706b904-e8cd-478e-a21b-857f22f06201 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:11.913045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-375b044a-ac12-49f8-b3ca-8065729933be req-8706b904-e8cd-478e-a21b-857f22f06201 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:11.925140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-375b044a-ac12-49f8-b3ca-8065729933be req-8706b904-e8cd-478e-a21b-857f22f06201 service nova] Creating event network-vif-plugged:2431c9fc-1050-4b52-9481-89b194766391 for instance e90c424b-9038-47c2-aa24-4c6b3f88b49d on hv-cinder-85221 Sep 01 17:47:11.930070 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-375b044a-ac12-49f8-b3ca-8065729933be req-8706b904-e8cd-478e-a21b-857f22f06201 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086957 Sep 01 17:47:11.930652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 568/1126] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:47:12.535770 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:12.536306 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:12.543023 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:12.543508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:12.543941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:12.544643 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:12.545087 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:12.545554 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:12.676560 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:12.684257 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-dbb685a7-d6e3-4c08-8f06-759875d57f4a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.152472 Sep 01 17:47:12.684826 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 559/1127] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:12 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:13.706572 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:13.707256 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:13.713408 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:13.713878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:13.714301 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:13.714976 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:13.715424 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:13.715836 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:13.849740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:13.857474 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ffa6b358-92d5-48ae-8d03-9fbe5eb3e13f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1264 microversion: 2.1 time: 0.155729 Sep 01 17:47:13.858025 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 569/1128] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:13 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:14.879305 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:14.879922 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:14.886535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:14.887093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:14.887679 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:14.888515 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:14.889059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:14.889628 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:15.018476 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:15.026516 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-aa37330e-324f-4591-a32a-d65cf6a46e97 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1448 microversion: 2.1 time: 0.151580 Sep 01 17:47:15.027079 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 560/1129] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:14 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:15.047499 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:47:15.048623 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:47:15.055071 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:15.055538 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:15.055962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:15.056662 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:15.057107 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:15.057553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:15.061482 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=77 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:47:15.185524 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:47:15.193732 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6c79bfb2-2bac-460a-9618-c7c3d58653be tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1448 microversion: 2.1 time: 0.150071 Sep 01 17:47:15.194293 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 570/1130] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:47:15 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1448 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:47:17.396432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-730fca7d-79d8-47aa-9cec-2b1b8402e62e req-fbdedb74-913e-4a4c-b93f-b7510e5e9c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e90c424b-9038-47c2-aa24-4c6b3f88b49d", "tag": "2431c9fc-1050-4b52-9481-89b194766391"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:47:17.409001 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-730fca7d-79d8-47aa-9cec-2b1b8402e62e req-fbdedb74-913e-4a4c-b93f-b7510e5e9c8c service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:47:17.409602 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-730fca7d-79d8-47aa-9cec-2b1b8402e62e req-fbdedb74-913e-4a4c-b93f-b7510e5e9c8c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:47:17.410059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-730fca7d-79d8-47aa-9cec-2b1b8402e62e req-fbdedb74-913e-4a4c-b93f-b7510e5e9c8c service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:47:17.422737 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-730fca7d-79d8-47aa-9cec-2b1b8402e62e req-fbdedb74-913e-4a4c-b93f-b7510e5e9c8c service nova] Creating event network-changed:2431c9fc-1050-4b52-9481-89b194766391 for instance e90c424b-9038-47c2-aa24-4c6b3f88b49d on hv-cinder-85221 Sep 01 17:47:17.428455 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-730fca7d-79d8-47aa-9cec-2b1b8402e62e req-fbdedb74-913e-4a4c-b93f-b7510e5e9c8c service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037886 Sep 01 17:47:17.429159 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 561/1131] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:25.241983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=13 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:25.242733 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=5 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:25.247662 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8eae6eaf-74e8-497d-8c91-43aa4a1e6a11 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:25.248157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8eae6eaf-74e8-497d-8c91-43aa4a1e6a11 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:25.255337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8eae6eaf-74e8-497d-8c91-43aa4a1e6a11 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.255824 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8eae6eaf-74e8-497d-8c91-43aa4a1e6a11 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.256258 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8eae6eaf-74e8-497d-8c91-43aa4a1e6a11 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.256959 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8eae6eaf-74e8-497d-8c91-43aa4a1e6a11 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.257445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8eae6eaf-74e8-497d-8c91-43aa4a1e6a11 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.257869 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8eae6eaf-74e8-497d-8c91-43aa4a1e6a11 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.289367 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8eae6eaf-74e8-497d-8c91-43aa4a1e6a11 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093/ips" status: 200 len: 149 microversion: 2.1 time: 0.049095 Sep 01 17:48:25.289955 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 571/1132] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:48:25 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:25.300680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=13 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:25.301491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=37 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:25.302467 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:48:25.302698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Thu Sep 1 17:48:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093/os-volume_attachments (ip 10.222.0.102) !!! Sep 01 17:48:25.309506 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "245315a9-907e-4888-b5d0-565009cfc7c3"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:25.312015 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:25.319991 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.320472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.320907 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.321647 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.322106 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.322535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.406016 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Invalid volume: volume 245315a9-907e-4888-b5d0-565009cfc7c3 is already attached to instances: 0120f498-e71f-4898-aef0-57306acb3599 Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: POST /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093/os-volume_attachments HTTP/1.1 Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 74 Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:48:25.407996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {"volumeAttachment": {"volumeId": "245315a9-907e-4888-b5d0-565009cfc7c3"}} Sep 01 17:48:25.409606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Invalid volume: volume 245315a9-907e-4888-b5d0-565009cfc7c3 is already attached to instances: 0120f498-e71f-4898-aef0-57306acb3599 Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'server_id': 'dd764166-44f4-4ee9-831d-dc94f3f62093', 'body': {'volumeAttachment': {'volumeId': '245315a9-907e-4888-b5d0-565009cfc7c3'}}} Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 245315a9-907e-4888-b5d0-565009cfc7c3 is already attached to instances: 0120f498-e71f-4898-aef0-57306acb3599 Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:48:25.410793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 245315a9-907e-4888-b5d0-565009cfc7c3 is already attached to instances: 0120f498-e71f-4898-aef0-57306acb3599 Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:25.412473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:48:25.414243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:48:25.414243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:48:25.414243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:48:25.414243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 245315a9-907e-4888-b5d0-565009cfc7c3 is already attached to instances: 0120f498-e71f-4898-aef0-57306acb3599 Sep 01 17:48:25.414243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:48:25.414243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 400 to user: Invalid volume: volume 245315a9-907e-4888-b5d0-565009cfc7c3 is already attached to instances: 0120f498-e71f-4898-aef0-57306acb3599 {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:48:25.414243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a1a5769f-f2d8-4b87-9e1b-8782a0c55ff4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111006 Sep 01 17:48:25.414243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 562/1133] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:48:25 2022] POST /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 17:48:25.418287 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:25.419402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:25.425491 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.425976 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.427188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.427188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.427519 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.427936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.453477 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:48:25.531736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-391dd452-aa16-40ec-aba5-b15bffa8b78b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 204 len: 0 microversion: 2.1 time: 0.116999 Sep 01 17:48:25.532301 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 572/1134] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:48:25 2022] DELETE /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:48:25.541971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:25.542581 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:25.550247 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.550786 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.551416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.552125 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:25.552578 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:25.552998 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:25.688995 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:25.696993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fd0bf5aa-1b2c-436d-b843-a8e80580e408 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1683 microversion: 2.1 time: 0.159338 Sep 01 17:48:25.697597 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 563/1135] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:25 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:26.719629 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:26.720334 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:26.727121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:26.727614 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:26.728051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:26.728753 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:26.729210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:26.729661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:26.869714 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:26.877639 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d769cda4-17ea-4aeb-b1d7-4bedaf909c58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1683 microversion: 2.1 time: 0.162723 Sep 01 17:48:26.878208 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 573/1136] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:26 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:27.898572 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:27.899188 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:27.908208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:27.908743 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:27.909177 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:27.909895 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:27.910365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:27.910790 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:28.048273 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:28.055993 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c02908fe-00d8-42c9-b5cd-c41fd6053e3e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1683 microversion: 2.1 time: 0.161335 Sep 01 17:48:28.056551 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 564/1137] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:27 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:29.079091 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:29.079807 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:29.088220 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:29.088715 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:29.089365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:29.090341 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:29.091475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:29.091909 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:29.113641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-a5bb5824-5070-4836-8e56-28d26a3c25fe req-bbc9e844-fb14-4c53-b5f7-ce6ce35f238e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd764166-44f4-4ee9-831d-dc94f3f62093", "name": "network-vif-deleted", "tag": "980bf536-0147-4722-b22a-bfe2f4711b89"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:29.132330 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-a5bb5824-5070-4836-8e56-28d26a3c25fe req-bbc9e844-fb14-4c53-b5f7-ce6ce35f238e service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:29.133063 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-a5bb5824-5070-4836-8e56-28d26a3c25fe req-bbc9e844-fb14-4c53-b5f7-ce6ce35f238e service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:29.133819 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-a5bb5824-5070-4836-8e56-28d26a3c25fe req-bbc9e844-fb14-4c53-b5f7-ce6ce35f238e service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:29.146826 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-a5bb5824-5070-4836-8e56-28d26a3c25fe req-bbc9e844-fb14-4c53-b5f7-ce6ce35f238e service nova] Creating event network-vif-deleted:980bf536-0147-4722-b22a-bfe2f4711b89 for instance dd764166-44f4-4ee9-831d-dc94f3f62093 on hv-cinder-85221 Sep 01 17:48:29.155046 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-a5bb5824-5070-4836-8e56-28d26a3c25fe req-bbc9e844-fb14-4c53-b5f7-ce6ce35f238e service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132337 Sep 01 17:48:29.155964 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 574/1138] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:29.208511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:29.219764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b83e1ac7-d163-4350-8e55-5fb2795c0fa4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 200 len: 1330 microversion: 2.1 time: 0.145439 Sep 01 17:48:29.220749 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 565/1139] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:29 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 1330 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:48:30.241996 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:30.242785 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:30.250540 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:30.251315 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:30.251749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:30.252462 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:30.252973 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:30.253491 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:30.271765 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 HTTP/1.1 Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:48:30.273125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:48:30.276571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'dd764166-44f4-4ee9-831d-dc94f3f62093'} Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:48:30.278001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:48:30.280304 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:30.282621 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:48:30.282621 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-a8806e80-d54b-44ff-8cad-0c71b50d1df0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 404 len: 111 microversion: 2.1 time: 0.037203 Sep 01 17:48:30.282621 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 575/1140] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:30 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:48:30.285645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-766c261a-3630-4520-9c1e-5d3e2334512a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '.version_select at 0x7fb8569c6ca0>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:30.311928 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-766c261a-3630-4520-9c1e-5d3e2334512a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203804241" status: 202 len: 0 microversion: 2.1 time: 0.031364 Sep 01 17:48:30.312520 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 566/1141] 10.222.0.102 () {58 vars in 1223 bytes} [Thu Sep 1 17:48:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203804241 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:48:30.991679 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:30.992167 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:30.999444 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:30.999943 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:31.000372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:31.001059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:31.001531 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:31.001946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:31.084540 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.objects.instance [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lazy-loading 'services' on Instance uuid 0120f498-e71f-4898-aef0-57306acb3599 {{(pid=121744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:48:31.159420 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0e6ed528-857e-4d0a-8e72-f3a4e0e33c4e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments/245315a9-907e-4888-b5d0-565009cfc7c3" status: 202 len: 0 microversion: 2.1 time: 0.171695 Sep 01 17:48:31.160350 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 576/1142] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:48:30 2022] DELETE /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments/245315a9-907e-4888-b5d0-565009cfc7c3 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:48:31.169017 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e5d2e01e-fea4-45e3-a3b1-56b4ca9d72a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:31.171193 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e5d2e01e-fea4-45e3-a3b1-56b4ca9d72a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:31.178416 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e5d2e01e-fea4-45e3-a3b1-56b4ca9d72a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:31.179028 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e5d2e01e-fea4-45e3-a3b1-56b4ca9d72a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:31.179464 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e5d2e01e-fea4-45e3-a3b1-56b4ca9d72a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:31.180155 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e5d2e01e-fea4-45e3-a3b1-56b4ca9d72a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:31.180598 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e5d2e01e-fea4-45e3-a3b1-56b4ca9d72a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:31.181011 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e5d2e01e-fea4-45e3-a3b1-56b4ca9d72a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:31.214912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e5d2e01e-fea4-45e3-a3b1-56b4ca9d72a1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049870 Sep 01 17:48:31.215487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 567/1143] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:48:31 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:32.228070 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6d715527-f9eb-4d30-ac2b-cfa3bc3956eb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:32.230372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6d715527-f9eb-4d30-ac2b-cfa3bc3956eb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:32.237669 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6d715527-f9eb-4d30-ac2b-cfa3bc3956eb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:32.238524 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6d715527-f9eb-4d30-ac2b-cfa3bc3956eb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:32.238749 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6d715527-f9eb-4d30-ac2b-cfa3bc3956eb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:32.239235 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6d715527-f9eb-4d30-ac2b-cfa3bc3956eb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:32.239942 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6d715527-f9eb-4d30-ac2b-cfa3bc3956eb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:32.240360 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6d715527-f9eb-4d30-ac2b-cfa3bc3956eb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:32.271763 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6d715527-f9eb-4d30-ac2b-cfa3bc3956eb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047984 Sep 01 17:48:32.272337 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 577/1144] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:48:32 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:33.284365 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-ea62c78c-6df1-458a-89b6-f3088cf6ef72 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:33.286593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-ea62c78c-6df1-458a-89b6-f3088cf6ef72 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:33.293133 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea62c78c-6df1-458a-89b6-f3088cf6ef72 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:33.294161 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea62c78c-6df1-458a-89b6-f3088cf6ef72 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:33.294591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea62c78c-6df1-458a-89b6-f3088cf6ef72 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:33.295285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea62c78c-6df1-458a-89b6-f3088cf6ef72 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:33.295735 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea62c78c-6df1-458a-89b6-f3088cf6ef72 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:33.296150 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-ea62c78c-6df1-458a-89b6-f3088cf6ef72 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:33.326866 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-ea62c78c-6df1-458a-89b6-f3088cf6ef72 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046474 Sep 01 17:48:33.327443 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 568/1145] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:48:33 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:48:33.391508 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:33.392090 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:33.398504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:33.398984 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:33.399414 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:33.400133 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:33.400585 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:33.401006 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:33.427385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:48:33.511070 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-caf8112e-a0af-4a1f-bc09-30da38c7a7a4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 204 len: 0 microversion: 2.1 time: 0.123099 Sep 01 17:48:33.511789 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 578/1146] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:48:33 2022] DELETE /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:48:33.520108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:33.520706 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:33.526803 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:33.527279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:33.527709 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:33.528932 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:33.529410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:33.529829 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:33.663347 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:33.672187 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2e856feb-dbff-4101-a153-4d4139b00fa9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1683 microversion: 2.1 time: 0.155977 Sep 01 17:48:33.672761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 569/1147] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:33 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:48:34.694209 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:34.694914 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:34.701412 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:34.701894 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:34.702328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:34.703031 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:34.703483 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:34.703901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:34.846495 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:34.855794 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0e89cc24-0046-4cb3-98b5-c1071db7ddda tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1683 microversion: 2.1 time: 0.165760 Sep 01 17:48:34.856862 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 579/1148] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:34 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:35.878296 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:35.878911 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:35.887847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:35.887847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:35.887847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:35.887847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:35.888338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:35.888338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:36.096958 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:36.104785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-fc202e76-27f4-4865-b797-4a5cf67e2477 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1683 microversion: 2.1 time: 0.230433 Sep 01 17:48:36.105371 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 570/1149] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:35 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1683 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:36.662322 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-6046e22c-a876-49d3-8bc9-77f52f99c161 req-69398ee7-ea10-40ee-a1b0-583ba731b296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0120f498-e71f-4898-aef0-57306acb3599", "name": "network-vif-deleted", "tag": "a294c79e-53ea-4036-87bb-8446552b1661"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:36.676232 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6046e22c-a876-49d3-8bc9-77f52f99c161 req-69398ee7-ea10-40ee-a1b0-583ba731b296 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:36.676866 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6046e22c-a876-49d3-8bc9-77f52f99c161 req-69398ee7-ea10-40ee-a1b0-583ba731b296 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:36.677513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-6046e22c-a876-49d3-8bc9-77f52f99c161 req-69398ee7-ea10-40ee-a1b0-583ba731b296 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:36.691605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-6046e22c-a876-49d3-8bc9-77f52f99c161 req-69398ee7-ea10-40ee-a1b0-583ba731b296 service nova] Creating event network-vif-deleted:a294c79e-53ea-4036-87bb-8446552b1661 for instance 0120f498-e71f-4898-aef0-57306acb3599 on hv-cinder-85221 Sep 01 17:48:36.698487 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-6046e22c-a876-49d3-8bc9-77f52f99c161 req-69398ee7-ea10-40ee-a1b0-583ba731b296 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042753 Sep 01 17:48:36.699096 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 580/1150] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:37.126837 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:37.127382 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:37.134021 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:37.134512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:37.134941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:37.135645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:37.136090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:37.136504 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:37.180775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:37.181259 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:37.181720 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:37.182170 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lazy-loading 'fault' on Instance uuid 0120f498-e71f-4898-aef0-57306acb3599 {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:48:37.228873 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:37.237277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-002518ae-662e-456e-bed7-32112f4512e9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 200 len: 1335 microversion: 2.1 time: 0.114987 Sep 01 17:48:37.238131 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 571/1151] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:37 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:38.259347 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:38.260034 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:38.267325 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:38.267797 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:38.268230 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:38.268910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:38.269451 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:38.269859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:38.283040 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 HTTP/1.1 Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:48:38.284659 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:48:38.286473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '0120f498-e71f-4898-aef0-57306acb3599'} Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:48:38.287344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:48:38.288953 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:48:38.290490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:48:38.290490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f279b21d-60b9-4ed0-8028-1ca5a54c8afa tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 404 len: 111 microversion: 2.1 time: 0.030942 Sep 01 17:48:38.290490 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 581/1152] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:38 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:48:38.295656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4b8de29c-a971-4c95-850c-f55241527349 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '.version_select at 0x7fb8564cba60>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:38.315119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4b8de29c-a971-4c95-850c-f55241527349 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-865008367" status: 202 len: 0 microversion: 2.1 time: 0.023807 Sep 01 17:48:38.315698 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 572/1153] 10.222.0.102 () {58 vars in 1223 bytes} [Thu Sep 1 17:48:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-865008367 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:48:38.963906 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3fef4d5a-64bd-49e7-82f9-520e168fb378 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: .version_select at 0x7fb856b0f790>, body: {"keypair": {"name": "tempest-keypair-1001902852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMHALK4iwtQ2/a9sh4DeNQu5dp6Q46dD5j+fLmb1b6gxgw1KV8UAcZatcC2l7HLoGmW9/4VHsW1/Qdl2VLaQbL1at4wT8Yl0yGiCcLzZ8KJXThbbnYOMJ6kRx4dVKxq0g=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:38.979913 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-3fef4d5a-64bd-49e7-82f9-520e168fb378 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for project de5f40e77a914f919f5bb15d11181f65. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:48:38.984556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-3fef4d5a-64bd-49e7-82f9-520e168fb378 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for user e7660433575a4daaaed075a6c8934934 and project de5f40e77a914f919f5bb15d11181f65. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:48:39.006949 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3fef4d5a-64bd-49e7-82f9-520e168fb378 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046921 Sep 01 17:48:39.007549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 582/1154] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:48:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:40.255271 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1750232418", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "071929ca-5336-44fd-8aa0-3c7ff215fc5e"}], "security_groups": [{"name": "tempest-securitygroup--1072942500"}], "key_name": "tempest-keypair-1001902852", "user_data": "}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:40.381083 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] validate_networks() for [('071929ca-5336-44fd-8aa0-3c7ff215fc5e', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:48:40.763286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:48:40.763702 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:48:40.764172 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:48:40.764571 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:48:40.765000 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:48:40.773851 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:40.774326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:40.774785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:40.775502 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:40.775944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:40.776364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:40.794056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for project de5f40e77a914f919f5bb15d11181f65. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:48:40.798111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for user e7660433575a4daaaed075a6c8934934 and project de5f40e77a914f919f5bb15d11181f65. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:48:40.812430 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:48:40.814839 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:48:40.863307 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-68932dfc-4f56-4b0f-8d92-035cf0bc3977 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.612827 Sep 01 17:48:40.863985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 573/1155] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:48:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:48:40.876592 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2dd0b2de-a945-4a88-983a-7b8871141e4b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:40.877217 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2dd0b2de-a945-4a88-983a-7b8871141e4b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:40.936605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-2dd0b2de-a945-4a88-983a-7b8871141e4b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:40.943946 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2dd0b2de-a945-4a88-983a-7b8871141e4b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1246 microversion: 2.1 time: 0.072635 Sep 01 17:48:40.944753 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 583/1156] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:40 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:41.966699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:41.967307 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:41.973857 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:41.974338 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:41.974783 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:41.975463 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:41.975919 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:41.976307 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:42.071077 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:42.081503 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-33089b66-00a0-4555-a018-56188659b211 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1306 microversion: 2.1 time: 0.119029 Sep 01 17:48:42.083953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 574/1157] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:41 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1306 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:43.103230 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:43.103981 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:43.111015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:43.111525 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:43.111947 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:43.112666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:43.113122 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:43.113571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:43.253851 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:43.262136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-223fb7fe-8af1-45df-8ffb-d4b7f6f15b85 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1372 microversion: 2.1 time: 0.163098 Sep 01 17:48:43.262977 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 584/1158] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:43 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:43.682884 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-11407e0c-dd5f-440e-b20d-258cc378e2d3 req-13b14e1b-d732-45e0-86fe-d29b2481200d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e92270c-76fd-4761-af16-9643a8845fa9", "tag": "aa6dbf10-d83d-40cf-91d6-a887c3c4fa91"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:43.693847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-11407e0c-dd5f-440e-b20d-258cc378e2d3 req-13b14e1b-d732-45e0-86fe-d29b2481200d service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:43.694452 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-11407e0c-dd5f-440e-b20d-258cc378e2d3 req-13b14e1b-d732-45e0-86fe-d29b2481200d service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:43.694965 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-11407e0c-dd5f-440e-b20d-258cc378e2d3 req-13b14e1b-d732-45e0-86fe-d29b2481200d service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:43.707917 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-11407e0c-dd5f-440e-b20d-258cc378e2d3 req-13b14e1b-d732-45e0-86fe-d29b2481200d service nova] Creating event network-changed:aa6dbf10-d83d-40cf-91d6-a887c3c4fa91 for instance 4e92270c-76fd-4761-af16-9643a8845fa9 on hv-cinder-85221 Sep 01 17:48:43.712939 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-11407e0c-dd5f-440e-b20d-258cc378e2d3 req-13b14e1b-d732-45e0-86fe-d29b2481200d service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 Sep 01 17:48:43.713579 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 575/1159] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:44.283132 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:44.283748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:44.290433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:44.290853 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:44.291286 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:44.291983 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:44.292433 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:44.292859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:44.424147 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:44.432792 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d94d22ed-9d8e-497c-a044-4cb968dda839 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1372 microversion: 2.1 time: 0.153654 Sep 01 17:48:44.433381 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 585/1160] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:44 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:45.455678 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:45.456378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:45.462593 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:45.463064 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:45.463494 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:45.464175 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:45.464625 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:45.465041 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:45.602478 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:45.610228 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c3a990dc-fcef-46fa-b6a5-3c1e597ea2bd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1372 microversion: 2.1 time: 0.160310 Sep 01 17:48:45.610797 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 576/1161] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:45 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:46.631438 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:46.632042 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:46.639062 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:46.639537 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:46.639965 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:46.640652 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:46.641097 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:46.641544 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:46.773830 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:46.782140 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-831b9bef-df56-45bf-8005-2c1f90d12a3a tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1372 microversion: 2.1 time: 0.154568 Sep 01 17:48:46.782715 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 586/1162] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:46 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:47.802750 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:47.803366 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:47.810476 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:47.810965 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:47.811437 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:47.812193 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:47.812682 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:47.813111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:47.946273 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:47.955400 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-13f7fee1-8662-47be-aea2-65dd6eac0ce1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1372 microversion: 2.1 time: 0.156360 Sep 01 17:48:47.955996 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 577/1163] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:47 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:48.976010 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:48.976607 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:48.983061 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:48.983541 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:48.983972 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:48.984661 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:48.985110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:48.985563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:49.113138 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:49.121109 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d32f4d03-3369-4f47-ac64-522d1fda4ba5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1372 microversion: 2.1 time: 0.148998 Sep 01 17:48:49.121744 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 587/1164] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:48 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:50.141223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:50.141795 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:50.148324 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:50.148804 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:50.149761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:50.149942 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:50.150391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:50.150808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:50.296109 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:50.304045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-f48d7e96-a51d-4089-9335-27a1cbe08bf2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1372 microversion: 2.1 time: 0.166802 Sep 01 17:48:50.304629 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 578/1165] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:50 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:50.323320 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-50252c6a-b81d-4efc-9127-df81b63e2551 req-8a092532-8fb2-4765-9dfb-7e935ae75c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e92270c-76fd-4761-af16-9643a8845fa9", "name": "network-vif-plugged", "status": "completed", "tag": "aa6dbf10-d83d-40cf-91d6-a887c3c4fa91"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:50.333894 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-50252c6a-b81d-4efc-9127-df81b63e2551 req-8a092532-8fb2-4765-9dfb-7e935ae75c88 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:50.334574 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-50252c6a-b81d-4efc-9127-df81b63e2551 req-8a092532-8fb2-4765-9dfb-7e935ae75c88 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:50.335027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-50252c6a-b81d-4efc-9127-df81b63e2551 req-8a092532-8fb2-4765-9dfb-7e935ae75c88 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:50.346795 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-50252c6a-b81d-4efc-9127-df81b63e2551 req-8a092532-8fb2-4765-9dfb-7e935ae75c88 service nova] Creating event network-vif-plugged:aa6dbf10-d83d-40cf-91d6-a887c3c4fa91 for instance 4e92270c-76fd-4761-af16-9643a8845fa9 on hv-cinder-85221 Sep 01 17:48:50.351643 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-50252c6a-b81d-4efc-9127-df81b63e2551 req-8a092532-8fb2-4765-9dfb-7e935ae75c88 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032148 Sep 01 17:48:50.352224 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 588/1166] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:51.327380 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:51.327997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:51.330195 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:51.330900 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=6 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:51.337243 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:51.337744 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:51.338176 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:51.338881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:51.339331 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:51.339745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:51.470485 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:51.478212 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-134ca40e-c8da-4232-b3bb-1b6de12a92d1 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1372 microversion: 2.1 time: 0.155048 Sep 01 17:48:51.478780 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 579/1167] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:51 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:52.497951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:52.502407 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:52.503128 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:52.515078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:52.515963 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:52.516789 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:52.518081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:52.518909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:52.519699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:52.525402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:48:52.659380 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:48:52.667721 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5dea771e-687d-4460-8160-107718ec3fb9 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1561 microversion: 2.1 time: 0.171285 Sep 01 17:48:52.668296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 589/1168] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:48:52 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:48:52.690903 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-7e8e8d29-4d25-49ce-a706-36dde0fdb3a0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:48:52.691499 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-7e8e8d29-4d25-49ce-a706-36dde0fdb3a0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:48:52.698244 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e8e8d29-4d25-49ce-a706-36dde0fdb3a0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:52.698718 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e8e8d29-4d25-49ce-a706-36dde0fdb3a0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:52.699244 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e8e8d29-4d25-49ce-a706-36dde0fdb3a0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:52.699959 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e8e8d29-4d25-49ce-a706-36dde0fdb3a0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:52.700405 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e8e8d29-4d25-49ce-a706-36dde0fdb3a0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:52.700817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-7e8e8d29-4d25-49ce-a706-36dde0fdb3a0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:52.788784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-7e8e8d29-4d25-49ce-a706-36dde0fdb3a0 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101652 Sep 01 17:48:52.789793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 580/1169] 10.222.0.102 () {58 vars in 1280 bytes} [Thu Sep 1 17:48:52 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:48:53.741143 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-69af85cf-0ba2-48d6-b146-7aa00903e567 req-babad541-e0a1-48bf-9fe0-0550fbb8c080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e92270c-76fd-4761-af16-9643a8845fa9", "tag": "aa6dbf10-d83d-40cf-91d6-a887c3c4fa91"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:48:53.751762 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-69af85cf-0ba2-48d6-b146-7aa00903e567 req-babad541-e0a1-48bf-9fe0-0550fbb8c080 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:48:53.752247 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-69af85cf-0ba2-48d6-b146-7aa00903e567 req-babad541-e0a1-48bf-9fe0-0550fbb8c080 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:48:53.752674 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-69af85cf-0ba2-48d6-b146-7aa00903e567 req-babad541-e0a1-48bf-9fe0-0550fbb8c080 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:48:53.765139 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-69af85cf-0ba2-48d6-b146-7aa00903e567 req-babad541-e0a1-48bf-9fe0-0550fbb8c080 service nova] Creating event network-changed:aa6dbf10-d83d-40cf-91d6-a887c3c4fa91 for instance 4e92270c-76fd-4761-af16-9643a8845fa9 on hv-cinder-85221 Sep 01 17:48:53.771473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-69af85cf-0ba2-48d6-b146-7aa00903e567 req-babad541-e0a1-48bf-9fe0-0550fbb8c080 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034107 Sep 01 17:48:53.772230 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 590/1170] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:49:44.686426 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:49:44.687161 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=94 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:49:44.691665 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:49:44.692184 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:44.700354 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:44.700825 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:44.701252 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:44.701949 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:44.702393 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:44.702805 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:44.726029 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lazy-loading 'flavor' on Instance uuid e90c424b-9038-47c2-aa24-4c6b3f88b49d {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:49:44.797481 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-682c14ed-285b-47d1-9812-3a838226be79 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "POST /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d/action" status: 202 len: 0 microversion: 2.1 time: 0.112200 Sep 01 17:49:44.798071 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 581/1171] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:49:44 2022] POST /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:49:44.805699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:49:44.806439 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:49:44.812327 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:44.812992 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:44.823028 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:44.823523 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:44.824328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:44.825092 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:44.825493 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:44.825918 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:44.967380 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:44.975208 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-94580126-27e1-4b8e-8ed4-b7d3926255ed tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.172649 Sep 01 17:49:44.975773 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 591/1172] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:44 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:45.998334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:45.999031 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:46.005260 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:46.005774 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:46.006208 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:46.006902 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:46.007352 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:46.007775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:46.143653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:46.151459 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-be08c772-3bcc-482e-8fae-07946548337e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.158429 Sep 01 17:49:46.152025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 582/1173] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:45 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:47.172006 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:47.172602 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:47.179102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:47.179580 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:47.180015 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:47.180699 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:47.181146 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:47.181588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:47.308240 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:47.315899 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-b7f54421-45b0-48e1-aa87-320ec875f931 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.147821 Sep 01 17:49:47.316456 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 592/1174] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:47 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:48.337606 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:48.338215 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:48.344721 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:48.345198 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:48.345656 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:48.346380 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:48.346830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:48.347250 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:48.479234 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:48.487129 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2397a53e-5b23-439a-b70c-3900d5d2ce5d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.153624 Sep 01 17:49:48.487693 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 583/1175] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:48 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:49.509067 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:49.509653 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:49.516465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:49.516936 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:49.517388 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:49.518067 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:49.518512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:49.518982 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:49.651553 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:49.659233 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-0035ff0b-f51b-45c2-ab8d-57b631869cf2 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.154256 Sep 01 17:49:49.659796 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 593/1176] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:49 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:50.680181 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:50.680792 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:50.687206 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:50.687686 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:50.688119 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:50.688799 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:50.689252 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:50.689695 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:50.820517 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:50.829326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b7c3f1d4-dfbe-4ff4-a22b-013767b24de4 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.152922 Sep 01 17:49:50.829910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 584/1177] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:50 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:51.852456 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:51.853065 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:51.860109 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:51.860581 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:51.861010 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:51.861736 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:51.862181 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:51.862594 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:51.991114 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:51.999116 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-433be1c8-0800-4c5c-9fc7-3d3286989c1d tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.150657 Sep 01 17:49:51.999679 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 594/1178] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:51 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:53.020229 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:53.020871 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:53.027487 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:53.028697 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:53.029130 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:53.029848 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:53.030301 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:53.030722 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:53.158874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:53.166695 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c966917e-f01d-4d19-9080-e7255d6929d5 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.150391 Sep 01 17:49:53.167254 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 585/1179] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:53 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:54.187691 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:54.188376 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:54.194988 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:54.195471 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:54.195907 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:54.196596 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:54.197125 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:54.197583 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:54.329409 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:54.339800 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-4bc2556a-907c-423f-ba89-60b36f5370cf tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.155893 Sep 01 17:49:54.341042 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 595/1180] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:54 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:55.361862 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:55.362472 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:55.369409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:55.369890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:55.370323 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:55.371009 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:55.372039 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:55.372465 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:55.582431 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:55.591136 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-a0c90623-e270-4e32-98af-60f618219bfb tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.232393 Sep 01 17:49:55.591971 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 586/1181] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:55 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:56.614408 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:56.615053 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:56.622310 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:56.622789 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:56.623218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:56.623902 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:56.624348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:56.624767 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:56.753157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:56.760910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-3d7d7859-3c6e-475c-b2bf-0cf025ca326a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.150451 Sep 01 17:49:56.761509 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 596/1182] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:56 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:49:57.781994 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:57.782560 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:57.788830 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:57.789318 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:57.789822 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:57.790497 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:57.790944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:57.791357 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:57.926424 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:57.934248 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b7617fab-db3a-4e94-93c8-537e66ba4511 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.156136 Sep 01 17:49:57.934796 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 587/1183] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:57 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:49:58.956181 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:58.956795 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:58.963236 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:58.963716 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:58.964145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:58.964836 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:58.965986 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:58.966408 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:59.097805 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:59.105729 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-63fcc2d5-0cbb-4692-97c7-92fdf83acbe6 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1514 microversion: 2.1 time: 0.153463 Sep 01 17:49:59.106305 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 597/1184] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:58 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:49:59.126168 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:49:59.126766 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:59.133169 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:59.133677 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:59.134108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:59.134788 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:59.135240 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:59.135667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:59.175452 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121745) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 17:49:59.242630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-33bb6bd2-3561-4a07-9617-899bb16dcb12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "POST /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d/action" status: 202 len: 0 microversion: 2.1 time: 0.120299 Sep 01 17:49:59.243251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 588/1185] 10.222.0.102 () {60 vars in 1283 bytes} [Thu Sep 1 17:49:59 2022] POST /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:49:59.251836 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:49:59.252441 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:49:59.262537 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:59.263413 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:59.264188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:59.265465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:49:59.266348 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:49:59.267379 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:49:59.438600 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:49:59.446355 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ef4a5e4b-eadf-4353-9724-760dddf9ce12 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1522 microversion: 2.1 time: 0.198782 Sep 01 17:49:59.446916 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 598/1186] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:49:59 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:00.468762 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:00.469335 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:00.475162 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:00.475637 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:00.476065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:00.476742 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:00.477199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:00.477643 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:00.607334 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:00.615096 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-2375b68d-bd7f-4ca2-b9d7-99e77c51685e tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1524 microversion: 2.1 time: 0.151441 Sep 01 17:50:00.615653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 589/1187] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:00 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1524 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:01.636068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:01.636680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:01.643279 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:01.643766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:01.644201 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:01.644901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:01.645382 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:01.645815 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:01.778075 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:01.786037 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ca7d84eb-908c-44f9-a132-bffde447680a tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1580 microversion: 2.1 time: 0.153870 Sep 01 17:50:01.786704 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 599/1188] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:01 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:02.594122 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-ff2363e4-057e-4f91-af0b-c6c0a52be7f8 req-c6f73e1a-f06c-4328-ab6b-abdd2e9231cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90c424b-9038-47c2-aa24-4c6b3f88b49d", "name": "network-vif-unplugged", "status": "completed", "tag": "2431c9fc-1050-4b52-9481-89b194766391"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:02.605511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-ff2363e4-057e-4f91-af0b-c6c0a52be7f8 req-c6f73e1a-f06c-4328-ab6b-abdd2e9231cc service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:02.606657 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-ff2363e4-057e-4f91-af0b-c6c0a52be7f8 req-c6f73e1a-f06c-4328-ab6b-abdd2e9231cc service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:02.607269 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-ff2363e4-057e-4f91-af0b-c6c0a52be7f8 req-c6f73e1a-f06c-4328-ab6b-abdd2e9231cc service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:02.619025 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-ff2363e4-057e-4f91-af0b-c6c0a52be7f8 req-c6f73e1a-f06c-4328-ab6b-abdd2e9231cc service nova] Creating event network-vif-unplugged:2431c9fc-1050-4b52-9481-89b194766391 for instance e90c424b-9038-47c2-aa24-4c6b3f88b49d on hv-cinder-85221 Sep 01 17:50:02.624142 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-ff2363e4-057e-4f91-af0b-c6c0a52be7f8 req-c6f73e1a-f06c-4328-ab6b-abdd2e9231cc service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034339 Sep 01 17:50:02.624779 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 590/1189] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:02.807521 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:02.808146 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:02.815314 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:02.815314 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:02.815567 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:02.816196 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:02.816636 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:02.817078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:02.950423 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:02.958645 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c18ac74f-0781-4dc9-88a6-34ee996c225b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1580 microversion: 2.1 time: 0.154965 Sep 01 17:50:02.959210 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 600/1190] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:02 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1580 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:03.981401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:03.982093 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:03.988662 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:03.989136 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:03.989592 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:03.990281 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:03.990723 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:03.991138 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:04.124065 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:04.131769 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-624e2fa7-1045-4d0a-bf9a-335cacfdf425 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1580 microversion: 2.1 time: 0.155264 Sep 01 17:50:04.132342 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 591/1191] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:03 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:05.154611 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:05.155146 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:05.161620 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:05.162102 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:05.162536 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:05.163223 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:05.163677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:05.164144 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:05.251365 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 17:50:05.251517 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Thu Sep 1 17:50:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d (ip 10.222.0.102) !!! Sep 01 17:50:05.306604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:05.315513 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-c9820db6-20a3-4df3-a241-32b246e02d05 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1580 microversion: 2.1 time: 0.165482 Sep 01 17:50:05.316081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 601/1192] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:05 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1580 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:06.338188 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:06.339095 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:06.347410 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:06.348134 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:06.348783 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:06.349824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:06.350550 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:06.351214 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:06.492988 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:06.501277 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-829db5de-afd2-4272-9844-d96d92826631 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1580 microversion: 2.1 time: 0.167972 Sep 01 17:50:06.501867 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 592/1193] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:06 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1580 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:07.522359 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:07.522890 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:07.529671 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:07.530154 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:07.530588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:07.531284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:07.531732 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:07.532158 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:07.663619 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:07.671995 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-6badf5b1-cb6e-4167-baa3-af7397dade0b tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1580 microversion: 2.1 time: 0.153752 Sep 01 17:50:07.672556 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 602/1194] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:07 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:08.691985 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:08.692591 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:08.699113 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:08.699601 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:08.700056 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:08.700747 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:08.701199 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:08.701652 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:08.831871 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:08.841921 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-247382bc-1961-40d4-83d7-7aca05821950 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1580 microversion: 2.1 time: 0.153766 Sep 01 17:50:08.842562 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 593/1195] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:08 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:09.861866 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:09.862464 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:09.869167 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:09.869673 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:09.870105 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:09.870791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:09.871242 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:09.871664 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:10.008494 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:10.016820 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-dddfa40e-b47b-47e0-8ab6-e77e9108b227 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1580 microversion: 2.1 time: 0.158834 Sep 01 17:50:10.017402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 603/1196] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:09 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1580 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:11.038120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:11.038728 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:11.045716 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:11.046189 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:11.046618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:11.047301 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:11.047751 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:11.048170 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:11.181453 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:11.189269 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-26efcaa7-563c-413f-b9d0-ba0e2b06931f tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1580 microversion: 2.1 time: 0.155068 Sep 01 17:50:11.189847 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 594/1197] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:11 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1580 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:12.211003 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:12.211569 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:12.217562 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:12.218038 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:12.218465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:12.219145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:12.219588 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:12.219999 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:12.364355 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:12.372434 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8419e69e-324c-4c76-9b2e-1825029346d1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1567 microversion: 2.1 time: 0.165637 Sep 01 17:50:12.373007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 604/1198] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:12 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:14.723255 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-0d01f18d-e4ba-4fb5-ab03-52a4762a1895 req-c7bb7865-0a16-4894-b3ba-d37b1b8db2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90c424b-9038-47c2-aa24-4c6b3f88b49d", "name": "network-vif-plugged", "status": "completed", "tag": "2431c9fc-1050-4b52-9481-89b194766391"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:14.729361 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:14.736576 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-0d01f18d-e4ba-4fb5-ab03-52a4762a1895 req-c7bb7865-0a16-4894-b3ba-d37b1b8db2a0 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:14.737279 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-0d01f18d-e4ba-4fb5-ab03-52a4762a1895 req-c7bb7865-0a16-4894-b3ba-d37b1b8db2a0 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:14.737800 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-0d01f18d-e4ba-4fb5-ab03-52a4762a1895 req-c7bb7865-0a16-4894-b3ba-d37b1b8db2a0 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:14.742777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:14.759557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-0d01f18d-e4ba-4fb5-ab03-52a4762a1895 req-c7bb7865-0a16-4894-b3ba-d37b1b8db2a0 service nova] Creating event network-vif-plugged:2431c9fc-1050-4b52-9481-89b194766391 for instance e90c424b-9038-47c2-aa24-4c6b3f88b49d on hv-cinder-85221 Sep 01 17:50:14.765680 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-0d01f18d-e4ba-4fb5-ab03-52a4762a1895 req-c7bb7865-0a16-4894-b3ba-d37b1b8db2a0 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046045 Sep 01 17:50:14.766364 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 595/1199] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:20.276680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-2a9c1712-1dfb-43da-a58a-4a7de0333c9c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:20.277178 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-2a9c1712-1dfb-43da-a58a-4a7de0333c9c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:20.279115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=29 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:20.284364 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2a9c1712-1dfb-43da-a58a-4a7de0333c9c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:20.284844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2a9c1712-1dfb-43da-a58a-4a7de0333c9c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:20.285272 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2a9c1712-1dfb-43da-a58a-4a7de0333c9c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:20.286045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2a9c1712-1dfb-43da-a58a-4a7de0333c9c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:20.286492 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2a9c1712-1dfb-43da-a58a-4a7de0333c9c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:20.286909 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-2a9c1712-1dfb-43da-a58a-4a7de0333c9c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:20.290651 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=85 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:20.311229 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-2a9c1712-1dfb-43da-a58a-4a7de0333c9c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/ips" status: 200 len: 149 microversion: 2.1 time: 0.095565 Sep 01 17:50:20.311769 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 605/1200] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:50:20 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:21.640959 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-dd5db630-ec32-4b7e-ac4f-8316300b8651 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4854f64b-d73d-489d-9710-04acde59ec33"}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:21.643373 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-dd5db630-ec32-4b7e-ac4f-8316300b8651 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:21.650292 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dd5db630-ec32-4b7e-ac4f-8316300b8651 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:21.650764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dd5db630-ec32-4b7e-ac4f-8316300b8651 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:21.651191 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dd5db630-ec32-4b7e-ac4f-8316300b8651 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:21.651865 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dd5db630-ec32-4b7e-ac4f-8316300b8651 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:21.652306 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dd5db630-ec32-4b7e-ac4f-8316300b8651 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:21.652714 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-dd5db630-ec32-4b7e-ac4f-8316300b8651 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:21.952469 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-dd5db630-ec32-4b7e-ac4f-8316300b8651 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317257 Sep 01 17:50:21.953121 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 596/1201] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:50:21 2022] POST /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:29.470642 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4854f64b-d73d-489d-9710-04acde59ec33"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:29.473095 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:29.479584 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:29.480068 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:29.480502 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:29.481188 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:29.482312 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:29.482735 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:29.562249 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Invalid volume: volume 4854f64b-d73d-489d-9710-04acde59ec33 is already attached to instances: 4e92270c-76fd-4761-af16-9643a8845fa9 Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: POST /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments HTTP/1.1 Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 74 Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:50:29.564001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {"volumeAttachment": {"volumeId": "4854f64b-d73d-489d-9710-04acde59ec33"}} Sep 01 17:50:29.565859 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Invalid volume: volume 4854f64b-d73d-489d-9710-04acde59ec33 is already attached to instances: 4e92270c-76fd-4761-af16-9643a8845fa9 Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'server_id': '4e92270c-76fd-4761-af16-9643a8845fa9', 'body': {'volumeAttachment': {'volumeId': '4854f64b-d73d-489d-9710-04acde59ec33'}}} Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4854f64b-d73d-489d-9710-04acde59ec33 is already attached to instances: 4e92270c-76fd-4761-af16-9643a8845fa9 Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:29.566874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4854f64b-d73d-489d-9710-04acde59ec33 is already attached to instances: 4e92270c-76fd-4761-af16-9643a8845fa9 Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:50:29.568476 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:50:29.570264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:50:29.570264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:50:29.570264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:50:29.570264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4854f64b-d73d-489d-9710-04acde59ec33 is already attached to instances: 4e92270c-76fd-4761-af16-9643a8845fa9 Sep 01 17:50:29.570264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:29.570264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 400 to user: Invalid volume: volume 4854f64b-d73d-489d-9710-04acde59ec33 is already attached to instances: 4e92270c-76fd-4761-af16-9643a8845fa9 {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:50:29.570264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-36402961-db99-48ba-94ac-ac346ce01833 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098781 Sep 01 17:50:29.570264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 606/1202] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:50:29 2022] POST /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 17:50:29.631149 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:29.631721 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:29.638336 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:29.638808 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:29.639232 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:29.639908 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:29.640347 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:29.640761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:29.734511 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lazy-loading 'services' on Instance uuid 4e92270c-76fd-4761-af16-9643a8845fa9 {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:50:29.816618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-83a2a261-cdce-4d68-b072-a2ad2c4e2deb tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments/4854f64b-d73d-489d-9710-04acde59ec33" status: 202 len: 0 microversion: 2.1 time: 0.189807 Sep 01 17:50:29.817213 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 597/1203] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:50:29 2022] DELETE /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments/4854f64b-d73d-489d-9710-04acde59ec33 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:50:29.826371 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f0f70439-e9d1-4e1e-b4c4-51d64d7bb33d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:29.828617 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f0f70439-e9d1-4e1e-b4c4-51d64d7bb33d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:29.835695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0f70439-e9d1-4e1e-b4c4-51d64d7bb33d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:29.836265 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0f70439-e9d1-4e1e-b4c4-51d64d7bb33d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:29.836776 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0f70439-e9d1-4e1e-b4c4-51d64d7bb33d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:29.837515 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0f70439-e9d1-4e1e-b4c4-51d64d7bb33d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:29.837963 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0f70439-e9d1-4e1e-b4c4-51d64d7bb33d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:29.838412 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f0f70439-e9d1-4e1e-b4c4-51d64d7bb33d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:29.869500 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f0f70439-e9d1-4e1e-b4c4-51d64d7bb33d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Sep 01 17:50:29.870002 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 607/1204] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:50:29 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:30.883049 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-16558849-6cc2-40e5-8ee1-72014230340e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:30.885391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-16558849-6cc2-40e5-8ee1-72014230340e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:30.892089 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-16558849-6cc2-40e5-8ee1-72014230340e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:30.892561 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-16558849-6cc2-40e5-8ee1-72014230340e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:30.892981 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-16558849-6cc2-40e5-8ee1-72014230340e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:30.893678 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-16558849-6cc2-40e5-8ee1-72014230340e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:30.894120 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-16558849-6cc2-40e5-8ee1-72014230340e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:30.894531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-16558849-6cc2-40e5-8ee1-72014230340e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:30.922603 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-16558849-6cc2-40e5-8ee1-72014230340e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044669 Sep 01 17:50:30.923144 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 598/1205] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:50:30 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:50:30.984110 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:30.984649 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:30.991252 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:30.991727 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:30.992410 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:30.993111 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:30.993592 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:30.994007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:31.022528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:50:31.102363 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-11dff3f3-c2c2-4d69-87b9-7ac8392d3dc5 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 204 len: 0 microversion: 2.1 time: 0.121483 Sep 01 17:50:31.103374 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 608/1206] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:50:30 2022] DELETE /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:50:31.112508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:31.113106 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:31.119853 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:31.120447 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:31.120874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:31.121596 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:31.122565 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:31.123690 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:31.261700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:31.269300 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-4e31832c-854b-4355-bd61-0ef82f8f5c51 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1686 microversion: 2.1 time: 0.160638 Sep 01 17:50:31.269879 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 599/1207] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:31 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:50:32.291266 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:32.291878 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:32.298246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:32.298724 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:32.299157 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:32.299831 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:32.300277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:32.300694 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:32.430714 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:32.439803 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-d486a77c-e413-42fc-8499-62ef162d2e8e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1686 microversion: 2.1 time: 0.152916 Sep 01 17:50:32.440435 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 609/1208] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:32 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:33.461567 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:33.462203 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:33.469358 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:33.469826 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:33.470248 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:33.470923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:33.471368 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:33.471775 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:33.687493 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:33.695178 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-62ab2088-5537-48c1-89d4-e12c255a93dc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1686 microversion: 2.1 time: 0.237547 Sep 01 17:50:33.695735 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 600/1209] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:33 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1686 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:34.435787 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-0b818c8d-8546-44d1-a78d-72be75316cfa req-6c9a94f9-e4a3-4558-8025-ea76473b837a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e92270c-76fd-4761-af16-9643a8845fa9", "name": "network-vif-deleted", "tag": "aa6dbf10-d83d-40cf-91d6-a887c3c4fa91"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:34.446729 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-0b818c8d-8546-44d1-a78d-72be75316cfa req-6c9a94f9-e4a3-4558-8025-ea76473b837a service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:34.447631 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-0b818c8d-8546-44d1-a78d-72be75316cfa req-6c9a94f9-e4a3-4558-8025-ea76473b837a service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:34.448132 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-0b818c8d-8546-44d1-a78d-72be75316cfa req-6c9a94f9-e4a3-4558-8025-ea76473b837a service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:34.461259 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-0b818c8d-8546-44d1-a78d-72be75316cfa req-6c9a94f9-e4a3-4558-8025-ea76473b837a service nova] Creating event network-vif-deleted:aa6dbf10-d83d-40cf-91d6-a887c3c4fa91 for instance 4e92270c-76fd-4761-af16-9643a8845fa9 on hv-cinder-85221 Sep 01 17:50:34.468289 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-0b818c8d-8546-44d1-a78d-72be75316cfa req-6c9a94f9-e4a3-4558-8025-ea76473b837a service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036102 Sep 01 17:50:34.469402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 610/1210] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:50:34.726194 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:34.727077 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:34.735938 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:34.736428 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:34.736936 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:34.737653 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:34.738104 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:34.738521 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:34.774475 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:34.774964 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:34.775397 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:34.775880 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lazy-loading 'fault' on Instance uuid 4e92270c-76fd-4761-af16-9643a8845fa9 {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:50:34.823104 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:34.831432 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-de9d6b54-551f-4c2d-a2b5-fa3ac3187bc8 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 200 len: 1336 microversion: 2.1 time: 0.116531 Sep 01 17:50:34.832000 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 601/1211] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:34 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:35.853979 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:35.854770 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:35.861738 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:35.862243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:35.862680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:35.863370 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:35.863823 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:35.864243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:35.878454 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 HTTP/1.1 Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:50:35.880078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:50:35.882791 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '4e92270c-76fd-4761-af16-9643a8845fa9'} Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:50:35.884555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:50:35.887504 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:50:35.889782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:50:35.889782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-01d2d212-47e5-4d54-8e24-0da059cade33 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 404 len: 111 microversion: 2.1 time: 0.032864 Sep 01 17:50:35.889782 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 611/1212] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:35 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:50:35.892180 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-89975ac2-2db6-42c3-ad03-442105c4f82b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '.version_select at 0x7fb8564e2430>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:35.910751 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-89975ac2-2db6-42c3-ad03-442105c4f82b tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001902852" status: 202 len: 0 microversion: 2.1 time: 0.022423 Sep 01 17:50:35.911335 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 602/1213] 10.222.0.102 () {58 vars in 1226 bytes} [Thu Sep 1 17:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001902852 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:50:36.545605 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-fecd14c1-fc4b-417b-8567-255c331321fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: .version_select at 0x7fb856835e50>, body: {"keypair": {"name": "tempest-keypair-1784534493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUs0MxfDhrJdJ5HttqOGcmJxvktkt4FNhZ4Rv5m7YPctE4y92gFfmO4cbW4inNa+jzmVDGcnCQIa4i0f3552syrFaewddQroFtGnYXjFErx8zQAxTuhm/8TalgA7TMoMg=="}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:36.560511 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-fecd14c1-fc4b-417b-8567-255c331321fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for project de5f40e77a914f919f5bb15d11181f65. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:50:36.564327 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.quota [None req-fecd14c1-fc4b-417b-8567-255c331321fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for user e7660433575a4daaaed075a6c8934934 and project de5f40e77a914f919f5bb15d11181f65. Resources: {'key_pairs'} {{(pid=121744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:50:36.587344 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-fecd14c1-fc4b-417b-8567-255c331321fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045626 Sep 01 17:50:36.588222 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 612/1214] 10.222.0.102 () {60 vars in 1164 bytes} [Thu Sep 1 17:50:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:37.822469 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1750758294", "imageRef": "a41d65cc-7038-49ae-88df-7dc657d6b6f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "071929ca-5336-44fd-8aa0-3c7ff215fc5e"}], "security_groups": [{"name": "tempest-securitygroup--688620959"}], "key_name": "tempest-keypair-1784534493", "user_data": "}} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:37.928500 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.network.neutron [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] validate_networks() for [('071929ca-5336-44fd-8aa0-3c7ff215fc5e', None, None, None, None, None)] {{(pid=121745) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 17:50:38.286043 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Flavor limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 17:50:38.286512 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Image limits 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 17:50:38.286950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Flavor pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 17:50:38.287348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Image pref 0:0:0 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 17:50:38.287776 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.virt.hardware [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 17:50:38.297024 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:38.297539 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:38.297963 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:38.298667 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:38.299111 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:38.299525 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:38.316376 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for project de5f40e77a914f919f5bb15d11181f65. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 17:50:38.320263 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.quota [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Getting quotas for user e7660433575a4daaaed075a6c8934934 and project de5f40e77a914f919f5bb15d11181f65. Resources: {'cores', 'instances', 'ram'} {{(pid=121745) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 17:50:38.330912 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Going to run 1 instances... {{(pid=121745) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 17:50:38.333217 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a41d65cc-7038-49ae-88df-7dc657d6b6f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121745) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 17:50:38.379950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-1ed5d6f1-a9eb-4b50-86e6-3f8fa7586925 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.562444 Sep 01 17:50:38.380817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 603/1215] 10.222.0.102 () {60 vars in 1152 bytes} [Thu Sep 1 17:50:37 2022] POST /compute/v2.1/servers => generated 403 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 17:50:38.392408 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-950cda49-0d17-49ab-ab6f-ca6345bf1a86 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:38.393136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-950cda49-0d17-49ab-ab6f-ca6345bf1a86 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:38.452956 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-950cda49-0d17-49ab-ab6f-ca6345bf1a86 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:38.460001 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-950cda49-0d17-49ab-ab6f-ca6345bf1a86 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1246 microversion: 2.1 time: 0.072013 Sep 01 17:50:38.460563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 613/1216] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:38 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:39.481548 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:39.482131 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:39.488810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:39.489286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:39.489744 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:39.490431 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:39.490877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:39.491300 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:39.576994 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:39.585294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-49d86709-85ba-4211-a80d-f8b26838cb58 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1306 microversion: 2.1 time: 0.108274 Sep 01 17:50:39.586188 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 604/1217] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:39 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:40.607488 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:40.608118 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:40.615193 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:40.615680 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:40.616115 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:40.616831 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:40.617578 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:40.618007 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:40.751370 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:40.759091 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-86bcf0d9-8b9d-494f-be13-bb201c37d5a7 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1371 microversion: 2.1 time: 0.156566 Sep 01 17:50:40.759651 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 614/1218] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:40 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:40.945535 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-2adc6503-0193-4ec9-a946-de2573c33db0 req-a37364dd-7765-44e8-bff2-401880e18bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80182d9c-37f1-4a4f-85dc-fb53f130932a", "tag": "cdcdbb38-85d0-4640-b851-3508c616d9ee"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:40.958745 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-2adc6503-0193-4ec9-a946-de2573c33db0 req-a37364dd-7765-44e8-bff2-401880e18bcf service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:40.959236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-2adc6503-0193-4ec9-a946-de2573c33db0 req-a37364dd-7765-44e8-bff2-401880e18bcf service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:40.959664 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-2adc6503-0193-4ec9-a946-de2573c33db0 req-a37364dd-7765-44e8-bff2-401880e18bcf service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:40.972359 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-2adc6503-0193-4ec9-a946-de2573c33db0 req-a37364dd-7765-44e8-bff2-401880e18bcf service nova] Creating event network-changed:cdcdbb38-85d0-4640-b851-3508c616d9ee for instance 80182d9c-37f1-4a4f-85dc-fb53f130932a on hv-cinder-85221 Sep 01 17:50:40.977583 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-2adc6503-0193-4ec9-a946-de2573c33db0 req-a37364dd-7765-44e8-bff2-401880e18bcf service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035820 Sep 01 17:50:40.979681 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 605/1219] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:41.780400 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:41.780974 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:41.787470 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:41.787951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:41.788385 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:41.789074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:41.789557 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:41.789987 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:41.919027 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:41.926685 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8d6e28bb-720b-4ea9-a21f-99222d7f552e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1371 microversion: 2.1 time: 0.150884 Sep 01 17:50:41.927259 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 615/1220] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:41 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:42.947724 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:42.948425 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:42.955129 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:42.955613 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:42.956045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:42.956727 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:42.957180 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:42.957631 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:43.090881 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:43.098599 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0f3936d6-fa5c-4004-b5a4-cc35cfc4565d tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1371 microversion: 2.1 time: 0.155146 Sep 01 17:50:43.099164 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 606/1221] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:42 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:44.120121 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:44.120730 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:44.127900 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:44.128387 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:44.128825 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:44.129571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:44.130013 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:44.130437 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:44.260860 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:44.268533 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ef0be743-82e5-4427-bd78-73dd299259db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1371 microversion: 2.1 time: 0.152745 Sep 01 17:50:44.269097 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 616/1222] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:44 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:45.288877 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:45.289834 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:45.298925 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:45.299409 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:45.299840 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:45.300569 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:45.301017 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:45.301474 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:45.432226 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:45.439855 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-3ef1e506-c333-49a7-9ed3-cab5658b0a8f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1371 microversion: 2.1 time: 0.155094 Sep 01 17:50:45.440421 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 607/1223] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:45 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:46.459933 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:46.460563 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:46.467048 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:46.467528 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:46.467962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:46.468644 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:46.469091 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:46.469543 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:46.600473 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:46.609417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-7866a4eb-17bf-4704-9683-b779de57b523 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1371 microversion: 2.1 time: 0.153271 Sep 01 17:50:46.613411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 617/1224] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:46 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:46.871817 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-d2d9f849-70bb-488b-9cb2-1c6322b58381 req-bf2366fd-f303-44e5-87cd-59cdb0e6f236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80182d9c-37f1-4a4f-85dc-fb53f130932a", "name": "network-vif-plugged", "status": "completed", "tag": "cdcdbb38-85d0-4640-b851-3508c616d9ee"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:46.882058 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-d2d9f849-70bb-488b-9cb2-1c6322b58381 req-bf2366fd-f303-44e5-87cd-59cdb0e6f236 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:46.882527 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-d2d9f849-70bb-488b-9cb2-1c6322b58381 req-bf2366fd-f303-44e5-87cd-59cdb0e6f236 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:46.882950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-d2d9f849-70bb-488b-9cb2-1c6322b58381 req-bf2366fd-f303-44e5-87cd-59cdb0e6f236 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:46.893966 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-d2d9f849-70bb-488b-9cb2-1c6322b58381 req-bf2366fd-f303-44e5-87cd-59cdb0e6f236 service nova] Creating event network-vif-plugged:cdcdbb38-85d0-4640-b851-3508c616d9ee for instance 80182d9c-37f1-4a4f-85dc-fb53f130932a on hv-cinder-85221 Sep 01 17:50:46.898923 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-d2d9f849-70bb-488b-9cb2-1c6322b58381 req-bf2366fd-f303-44e5-87cd-59cdb0e6f236 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030811 Sep 01 17:50:46.899533 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 608/1225] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:50:47.630277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:47.630891 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:47.638158 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:47.638641 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:47.639074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:47.639766 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:47.640218 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:47.640642 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:47.766042 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:47.773728 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-f3b521a3-c96b-4202-86ab-fc6039431c57 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1371 microversion: 2.1 time: 0.147341 Sep 01 17:50:47.774284 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 618/1226] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:47 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:48.792003 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:48.792851 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell0:SELECT=6 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:48.797585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:48.798271 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:48.805764 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:48.806236 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:48.806699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:48.807378 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:48.807824 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:48.808240 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:48.942257 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:50:48.950072 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-e178d92c-e642-43fe-94b9-1a966f81d116 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1561 microversion: 2.1 time: 0.159462 Sep 01 17:50:48.950630 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 609/1227] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:50:48 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:50:48.970351 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-77a5eac9-1ba5-4063-b6a8-5aea56ea8d41 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:50:48.970889 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-77a5eac9-1ba5-4063-b6a8-5aea56ea8d41 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:50:48.972835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell0:SELECT=6 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:50:48.978452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-77a5eac9-1ba5-4063-b6a8-5aea56ea8d41 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:48.978932 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-77a5eac9-1ba5-4063-b6a8-5aea56ea8d41 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:48.979392 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-77a5eac9-1ba5-4063-b6a8-5aea56ea8d41 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:48.980081 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-77a5eac9-1ba5-4063-b6a8-5aea56ea8d41 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:48.980530 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-77a5eac9-1ba5-4063-b6a8-5aea56ea8d41 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:48.981604 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-77a5eac9-1ba5-4063-b6a8-5aea56ea8d41 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:49.056873 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-77a5eac9-1ba5-4063-b6a8-5aea56ea8d41 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090412 Sep 01 17:50:49.057555 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 619/1228] 10.222.0.102 () {58 vars in 1280 bytes} [Thu Sep 1 17:50:48 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:50:50.312164 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-79bbe46e-10d0-48dc-8025-7531dec9e8bc req-d22fa0d1-4293-4d26-a844-539064d4fb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80182d9c-37f1-4a4f-85dc-fb53f130932a", "tag": "cdcdbb38-85d0-4640-b851-3508c616d9ee"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:50:50.322386 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-79bbe46e-10d0-48dc-8025-7531dec9e8bc req-d22fa0d1-4293-4d26-a844-539064d4fb49 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:50:50.322872 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-79bbe46e-10d0-48dc-8025-7531dec9e8bc req-d22fa0d1-4293-4d26-a844-539064d4fb49 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:50:50.323310 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-79bbe46e-10d0-48dc-8025-7531dec9e8bc req-d22fa0d1-4293-4d26-a844-539064d4fb49 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:50:50.338254 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-79bbe46e-10d0-48dc-8025-7531dec9e8bc req-d22fa0d1-4293-4d26-a844-539064d4fb49 service nova] Creating event network-changed:cdcdbb38-85d0-4640-b851-3508c616d9ee for instance 80182d9c-37f1-4a4f-85dc-fb53f130932a on hv-cinder-85221 Sep 01 17:50:50.343860 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-79bbe46e-10d0-48dc-8025-7531dec9e8bc req-d22fa0d1-4293-4d26-a844-539064d4fb49 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113422 Sep 01 17:50:50.344743 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 610/1229] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:51:57.644156 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:51:57.648202 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:51:57.648997 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:51:57.649402 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:51:57.655951 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-bf510956-e1d9-4ead-8183-c9436f102b39 req-8dfd1953-c404-4928-a500-e0cd6ca58859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e90c424b-9038-47c2-aa24-4c6b3f88b49d", "tag": "2431c9fc-1050-4b52-9481-89b194766391"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:51:57.662788 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:51:57.663318 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:51:57.669654 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-bf510956-e1d9-4ead-8183-c9436f102b39 req-8dfd1953-c404-4928-a500-e0cd6ca58859 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:51:57.670265 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-bf510956-e1d9-4ead-8183-c9436f102b39 req-8dfd1953-c404-4928-a500-e0cd6ca58859 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:51:57.670746 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-bf510956-e1d9-4ead-8183-c9436f102b39 req-8dfd1953-c404-4928-a500-e0cd6ca58859 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:51:57.670896 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:51:57.671340 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:51:57.671777 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:51:57.672482 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:51:57.672939 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:51:57.673395 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:51:57.684049 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-bf510956-e1d9-4ead-8183-c9436f102b39 req-8dfd1953-c404-4928-a500-e0cd6ca58859 service nova] Creating event network-changed:2431c9fc-1050-4b52-9481-89b194766391 for instance e90c424b-9038-47c2-aa24-4c6b3f88b49d on hv-cinder-85221 Sep 01 17:51:57.689793 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-bf510956-e1d9-4ead-8183-c9436f102b39 req-8dfd1953-c404-4928-a500-e0cd6ca58859 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043488 Sep 01 17:51:57.690568 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 611/1230] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:51:57.704737 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:51:57.785445 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-19a3dc24-16cc-432f-87d4-b9b351a16fea tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "DELETE /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 204 len: 0 microversion: 2.1 time: 0.143158 Sep 01 17:51:57.786265 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 620/1231] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:51:57 2022] DELETE /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 17:51:57.795097 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:51:57.795935 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:51:57.803180 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:51:57.803784 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:51:57.804284 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:51:57.805054 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:51:57.805708 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:51:57.806294 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:51:58.258074 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:51:58.266008 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-666f7ec2-69e7-4808-a30c-6e7d8da8deb1 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.475149 Sep 01 17:51:58.266557 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 612/1232] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:51:57 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:51:59.288401 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:51:59.289099 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:51:59.295684 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:51:59.296712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:51:59.297148 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:51:59.297874 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:51:59.298328 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:51:59.298748 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:51:59.503901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:51:59.511857 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-5d875583-5124-4927-b209-940d775442b0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1573 microversion: 2.1 time: 0.227789 Sep 01 17:51:59.512421 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 621/1233] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:51:59 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1573 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:52:00.351761 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [req-fbc27530-0b15-48b2-b5bc-de1b9d62caf1 req-401da00b-d050-4f99-99f8-06690d9e5f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90c424b-9038-47c2-aa24-4c6b3f88b49d", "name": "network-vif-deleted", "tag": "2431c9fc-1050-4b52-9481-89b194766391"}]} {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:52:00.363572 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fbc27530-0b15-48b2-b5bc-de1b9d62caf1 req-401da00b-d050-4f99-99f8-06690d9e5f8e service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:00.364045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fbc27530-0b15-48b2-b5bc-de1b9d62caf1 req-401da00b-d050-4f99-99f8-06690d9e5f8e service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:00.364470 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [req-fbc27530-0b15-48b2-b5bc-de1b9d62caf1 req-401da00b-d050-4f99-99f8-06690d9e5f8e service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:00.376916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.compute.server_external_events [req-fbc27530-0b15-48b2-b5bc-de1b9d62caf1 req-401da00b-d050-4f99-99f8-06690d9e5f8e service nova] Creating event network-vif-deleted:2431c9fc-1050-4b52-9481-89b194766391 for instance e90c424b-9038-47c2-aa24-4c6b3f88b49d on hv-cinder-85221 Sep 01 17:52:00.383282 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [req-fbc27530-0b15-48b2-b5bc-de1b9d62caf1 req-401da00b-d050-4f99-99f8-06690d9e5f8e service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035255 Sep 01 17:52:00.383883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 613/1234] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:00.533452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:00.533985 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:00.540296 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:00.540774 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:00.541207 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:00.541919 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:00.542372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:00.542790 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:00.607841 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa2b12905ac4709947cbeb9db264f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85538f245b5b4f4d8799169e2857278d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:00.616341 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-20688fb5-0d37-46ff-b607-12c480d0d997 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 200 len: 1223 microversion: 2.1 time: 0.086828 Sep 01 17:52:00.622912 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 622/1235] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:00 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:01.638546 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:01.639237 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] [instance: e90c424b-9038-47c2-aa24-4c6b3f88b49d] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:01.646618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:01.647090 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:01.647518 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:01.648196 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:01.648645 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:01.649059 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:01.662194 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] HTTP exception thrown: Instance e90c424b-9038-47c2-aa24-4c6b3f88b49d could not be found. Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Request method failure captured: Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d HTTP/1.1 Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO_1A6OM1uItiCj5xciYg3SZnOH_agkuAsa76tsOCs7BG8DzSUq6H0VYLBNytZhkewYn6HtNXVCN1Mf0YT_8CtSj-4GmGiW7MLjUkRhu9x_VGoHXc033ZtEgMEA4_MbCyb_E8JxmiTnG-O1JB_qPwYZLeRKHV2utrcoo_5UMArhbUYs Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: 85538f245b5b4f4d8799169e2857278d Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-TestShelveInstance-685985344 Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:52:01.663785 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_85538f245b5b4f4d8799169e2857278d", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/85538f245b5b4f4d8799169e2857278d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/85538f245b5b4f4d8799169e2857278d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/85538f245b5b4f4d8799169e2857278d"}]}] Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-TestShelveInstance-685985344 Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: 85538f245b5b4f4d8799169e2857278d Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-TestShelveInstance-685985344 Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-TestShelveInstance-685985344-project Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: cfa2b12905ac4709947cbeb9db264f33 Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-TestShelveInstance-685985344-project Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance e90c424b-9038-47c2-aa24-4c6b3f88b49d could not be found. Sep 01 17:52:01.665618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': 'e90c424b-9038-47c2-aa24-4c6b3f88b49d'} Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e90c424b-9038-47c2-aa24-4c6b3f88b49d could not be found. Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:01.666687 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e90c424b-9038-47c2-aa24-4c6b3f88b49d could not be found. Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e90c424b-9038-47c2-aa24-4c6b3f88b49d could not be found. Sep 01 17:52:01.668401 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:01.669944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Returning 404 to user: Instance e90c424b-9038-47c2-aa24-4c6b3f88b49d could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:01.669944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6e4630d2-f171-4687-a95c-3bf1b0ace61c tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d" status: 404 len: 111 microversion: 2.1 time: 0.030970 Sep 01 17:52:01.669944 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 614/1236] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:01 2022] GET /compute/v2.1/servers/e90c424b-9038-47c2-aa24-4c6b3f88b49d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:01.822931 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-33797a74-4210-454b-aed3-03e8faa9f3a0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] Calling method '.version_select at 0x7fb8568b1940>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:01.841962 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-33797a74-4210-454b-aed3-03e8faa9f3a0 tempest-TestShelveInstance-685985344 tempest-TestShelveInstance-685985344-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2036457186" status: 202 len: 0 microversion: 2.1 time: 0.022979 Sep 01 17:52:01.842545 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 623/1237] 10.222.0.102 () {58 vars in 1259 bytes} [Thu Sep 1 17:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2036457186 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:52:08.501508 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-852e6b76-0430-41da-98ba-49bf814d799f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:08.502040 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-852e6b76-0430-41da-98ba-49bf814d799f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:08.508883 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-852e6b76-0430-41da-98ba-49bf814d799f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:08.509402 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-852e6b76-0430-41da-98ba-49bf814d799f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:08.509837 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-852e6b76-0430-41da-98ba-49bf814d799f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:08.510542 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-852e6b76-0430-41da-98ba-49bf814d799f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:08.511022 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-852e6b76-0430-41da-98ba-49bf814d799f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:08.511442 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-852e6b76-0430-41da-98ba-49bf814d799f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:08.537789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-852e6b76-0430-41da-98ba-49bf814d799f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/ips" status: 200 len: 150 microversion: 2.1 time: 0.040036 Sep 01 17:52:08.538420 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 615/1238] 10.222.0.102 () {58 vars in 1253 bytes} [Thu Sep 1 17:52:08 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:09.940935 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-8afeda56-6d07-4c1b-94b3-7fa3f711d046 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4db268a4-dd5b-4694-9196-1fe6915285bd"}} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:52:09.943255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-8afeda56-6d07-4c1b-94b3-7fa3f711d046 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:09.949807 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8afeda56-6d07-4c1b-94b3-7fa3f711d046 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:09.950289 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8afeda56-6d07-4c1b-94b3-7fa3f711d046 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:09.950721 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8afeda56-6d07-4c1b-94b3-7fa3f711d046 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:09.951399 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8afeda56-6d07-4c1b-94b3-7fa3f711d046 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:09.951847 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8afeda56-6d07-4c1b-94b3-7fa3f711d046 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:09.952268 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-8afeda56-6d07-4c1b-94b3-7fa3f711d046 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:10.216697 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-8afeda56-6d07-4c1b-94b3-7fa3f711d046 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "POST /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280206 Sep 01 17:52:10.217377 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 624/1239] 10.222.0.102 () {60 vars in 1328 bytes} [Thu Sep 1 17:52:09 2022] POST /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:17.820391 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:17.820890 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:17.826874 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:17.827354 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:17.827788 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:17.828473 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:17.828927 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:17.829963 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:17.914759 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lazy-loading 'services' on Instance uuid 80182d9c-37f1-4a4f-85dc-fb53f130932a {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:52:17.984101 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-984bb773-e14b-4861-89b1-e7d384185945 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-volume_attachments/4db268a4-dd5b-4694-9196-1fe6915285bd" status: 202 len: 0 microversion: 2.1 time: 0.167765 Sep 01 17:52:17.984695 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 616/1240] 10.222.0.102 () {58 vars in 1421 bytes} [Thu Sep 1 17:52:17 2022] DELETE /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-volume_attachments/4db268a4-dd5b-4694-9196-1fe6915285bd => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:52:17.994236 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-ddca46bd-857a-4d42-b692-b5a8f0725a81 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:17.996609 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-ddca46bd-857a-4d42-b692-b5a8f0725a81 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:18.003498 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ddca46bd-857a-4d42-b692-b5a8f0725a81 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:18.003951 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ddca46bd-857a-4d42-b692-b5a8f0725a81 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:18.004372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ddca46bd-857a-4d42-b692-b5a8f0725a81 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:18.005277 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ddca46bd-857a-4d42-b692-b5a8f0725a81 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:18.005769 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ddca46bd-857a-4d42-b692-b5a8f0725a81 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:18.006197 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-ddca46bd-857a-4d42-b692-b5a8f0725a81 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:18.036881 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-ddca46bd-857a-4d42-b692-b5a8f0725a81 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047317 Sep 01 17:52:18.037478 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 625/1241] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:52:17 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:19.049758 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-6cfddaf2-f371-4497-9428-78bb3066a6ae tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:19.052203 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-6cfddaf2-f371-4497-9428-78bb3066a6ae tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:19.058285 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6cfddaf2-f371-4497-9428-78bb3066a6ae tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:19.058753 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6cfddaf2-f371-4497-9428-78bb3066a6ae tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:19.059175 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6cfddaf2-f371-4497-9428-78bb3066a6ae tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:19.059843 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6cfddaf2-f371-4497-9428-78bb3066a6ae tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:19.060286 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6cfddaf2-f371-4497-9428-78bb3066a6ae tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:19.060700 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-6cfddaf2-f371-4497-9428-78bb3066a6ae tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:19.089585 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-6cfddaf2-f371-4497-9428-78bb3066a6ae tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044514 Sep 01 17:52:19.090333 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 617/1242] 10.222.0.102 () {58 vars in 1307 bytes} [Thu Sep 1 17:52:19 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 17:52:19.151930 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:19.152452 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:19.158901 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:19.159411 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:19.159849 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:19.160566 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:19.161078 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:19.161571 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:19.188596 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Going to try to terminate instance {{(pid=121744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 17:52:19.266728 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-aecaefba-f47c-42fa-a112-efb3a6a17b90 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 204 len: 0 microversion: 2.1 time: 0.118234 Sep 01 17:52:19.267391 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 626/1243] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:52:19 2022] DELETE /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 17:52:19.276298 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:19.277006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:19.284274 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:19.285062 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:19.285394 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:19.286085 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:19.286551 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:19.286953 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:19.419223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:19.427729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-94aae195-1c7b-4b08-a738-86b2d37bd8cd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1686 microversion: 2.1 time: 0.155934 Sep 01 17:52:19.428283 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 618/1244] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:19 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:20.449131 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:20.449855 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:20.456435 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:20.456916 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:20.457373 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:20.458066 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:20.458516 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:20.458943 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:20.587360 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.policy [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:20.596407 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-dfa71cb4-748d-42d5-991e-65ae3c240482 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1686 microversion: 2.1 time: 0.151489 Sep 01 17:52:20.596982 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 627/1245] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:20 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:21.617814 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:21.618418 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:21.624753 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:21.625227 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:21.625729 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:21.626914 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:21.627357 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:21.627777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:22.138777 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:22.146648 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c273196b-815e-4b96-825f-9bfb73e5f295 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1686 microversion: 2.1 time: 0.533074 Sep 01 17:52:22.147407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 619/1246] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:21 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1686 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:22.586145 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [req-cf1e3eb9-96f2-45b9-b1e4-dca2d2ea3257 req-937202a9-b63b-4dd5-ae2d-07865dda8592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80182d9c-37f1-4a4f-85dc-fb53f130932a", "name": "network-vif-deleted", "tag": "cdcdbb38-85d0-4640-b851-3508c616d9ee"}]} {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:52:22.597573 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-cf1e3eb9-96f2-45b9-b1e4-dca2d2ea3257 req-937202a9-b63b-4dd5-ae2d-07865dda8592 service nova] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:22.598045 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-cf1e3eb9-96f2-45b9-b1e4-dca2d2ea3257 req-937202a9-b63b-4dd5-ae2d-07865dda8592 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:22.598468 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [req-cf1e3eb9-96f2-45b9-b1e4-dca2d2ea3257 req-937202a9-b63b-4dd5-ae2d-07865dda8592 service nova] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:22.612529 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.compute.server_external_events [req-cf1e3eb9-96f2-45b9-b1e4-dca2d2ea3257 req-937202a9-b63b-4dd5-ae2d-07865dda8592 service nova] Creating event network-vif-deleted:cdcdbb38-85d0-4640-b851-3508c616d9ee for instance 80182d9c-37f1-4a4f-85dc-fb53f130932a on hv-cinder-85221 Sep 01 17:52:22.618614 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [req-cf1e3eb9-96f2-45b9-b1e4-dca2d2ea3257 req-937202a9-b63b-4dd5-ae2d-07865dda8592 service nova] 10.222.0.102 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036130 Sep 01 17:52:22.619239 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 628/1247] 10.222.0.102 () {64 vars in 1322 bytes} [Thu Sep 1 17:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:52:23.168352 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:23.169235 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:23.176769 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:23.177618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:23.178233 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:23.179140 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:23.179589 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:23.180006 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:23.214444 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:23.214916 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:23.215345 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:23.215780 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.objects.instance [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lazy-loading 'fault' on Instance uuid 80182d9c-37f1-4a4f-85dc-fb53f130932a {{(pid=121745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 17:52:23.258504 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.policy [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7660433575a4daaaed075a6c8934934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5f40e77a914f919f5bb15d11181f65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121745) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 17:52:23.265728 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-708b52c8-808c-4463-9017-cc8dc8559cfd tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 200 len: 1336 microversion: 2.1 time: 0.101403 Sep 01 17:52:23.266287 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 620/1248] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:23 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:52:24.287835 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:24.288615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:24.295506 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:24.296029 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:24.296465 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:24.297156 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:24.297638 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:24.298135 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:24.311074 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a HTTP/1.1 Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:52:24.312677 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:24.314534 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '80182d9c-37f1-4a4f-85dc-fb53f130932a'} Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:24.315549 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:24.317248 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:24.318826 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:24.318826 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-47325457-aded-475a-bd59-231df7a7d1c2 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 404 len: 111 microversion: 2.1 time: 0.031898 Sep 01 17:52:24.318826 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 629/1249] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:24 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:24.322984 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-c304a16d-984a-4472-b1b8-42dad06ce886 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '.version_select at 0x7fb8564dbe50>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:24.341614 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-c304a16d-984a-4472-b1b8-42dad06ce886 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784534493" status: 202 len: 0 microversion: 2.1 time: 0.022542 Sep 01 17:52:24.342141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 621/1250] 10.222.0.102 () {58 vars in 1226 bytes} [Thu Sep 1 17:52:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784534493 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 17:52:26.072468 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:26.072987 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:26.080367 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.080839 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.081266 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.081976 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.082417 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.082831 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.096141 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: DELETE /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a HTTP/1.1 Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:52:26.097740 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.099479 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '80182d9c-37f1-4a4f-85dc-fb53f130932a'} Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:26.100634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.102526 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.104241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:26.104241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-32ff4a46-4fec-4a90-a009-a1cdf984e8fc tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 404 len: 111 microversion: 2.1 time: 0.030493 Sep 01 17:52:26.104241 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 630/1251] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:52:26 2022] DELETE /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:26.109438 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:26.110223 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 80182d9c-37f1-4a4f-85dc-fb53f130932a] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:26.118389 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.118979 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.119519 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.120379 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:26.120941 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:26.121491 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:26.137357 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a HTTP/1.1 Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:52:26.139460 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.141141 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '80182d9c-37f1-4a4f-85dc-fb53f130932a'} Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:26.142810 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. Sep 01 17:52:26.144407 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:26.145833 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance 80182d9c-37f1-4a4f-85dc-fb53f130932a could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:26.145833 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-9530e164-7b4a-4bf6-a53f-e121870b7bc4 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a" status: 404 len: 111 microversion: 2.1 time: 0.037229 Sep 01 17:52:26.145833 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 622/1252] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:26 2022] GET /compute/v2.1/servers/80182d9c-37f1-4a4f-85dc-fb53f130932a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 17:52:27.288311 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:27.288854 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:27.295244 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:27.295712 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:27.296136 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:27.296816 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:27.297257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:27.297695 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:27.311583 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: DELETE /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 HTTP/1.1 Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:52:27.313246 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.315666 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '4e92270c-76fd-4761-af16-9643a8845fa9'} Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:27.316616 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.318343 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.319897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:27.319897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-e04080e9-a679-451d-9962-b4f5d765c8f3 tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 404 len: 111 microversion: 2.1 time: 0.030736 Sep 01 17:52:27.319897 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 631/1253] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:52:27 2022] DELETE /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:27.323773 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:27.324392 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 4e92270c-76fd-4761-af16-9643a8845fa9] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:27.330918 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:27.331398 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:27.331835 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:27.332545 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:27.332978 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:27.333423 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:27.346655 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 HTTP/1.1 Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:52:27.348329 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.350108 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '4e92270c-76fd-4761-af16-9643a8845fa9'} Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:27.351078 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. Sep 01 17:52:27.352734 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.354251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance 4e92270c-76fd-4761-af16-9643a8845fa9 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:27.354251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-44a5ea43-1d10-4a0a-b91a-d0e68ed600db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9" status: 404 len: 111 microversion: 2.1 time: 0.029777 Sep 01 17:52:27.354251 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 623/1254] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:27 2022] GET /compute/v2.1/servers/4e92270c-76fd-4761-af16-9643a8845fa9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:27.361243 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:27.362031 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:27.369480 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:27.369939 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:27.370373 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:27.371051 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:27.371496 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:27.371910 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:27.385728 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: DELETE /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 HTTP/1.1 Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:52:27.387257 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.390372 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': 'dd764166-44f4-4ee9-831d-dc94f3f62093'} Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:27.391923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.395657 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.398486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:27.398486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-23d7ba47-ed4d-4174-9a70-c960b8ce48db tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 404 len: 111 microversion: 2.1 time: 0.033896 Sep 01 17:52:27.398486 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 632/1255] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:52:27 2022] DELETE /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:27.398781 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:27.398781 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: dd764166-44f4-4ee9-831d-dc94f3f62093] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:27.404413 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:27.404894 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:27.405354 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:27.406050 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:27.406505 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:27.406950 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:27.420981 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 HTTP/1.1 Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:52:27.422540 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.424948 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': 'dd764166-44f4-4ee9-831d-dc94f3f62093'} Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:27.426116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. Sep 01 17:52:27.427789 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:27.429348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance dd764166-44f4-4ee9-831d-dc94f3f62093 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:27.429348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-0426e62d-3309-4a1f-9d47-656fc91ef12e tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093" status: 404 len: 111 microversion: 2.1 time: 0.030848 Sep 01 17:52:27.429348 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 624/1256] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:27 2022] GET /compute/v2.1/servers/dd764166-44f4-4ee9-831d-dc94f3f62093 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:28.569923 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:28.570512 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.compute.api [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:28.572797 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:52:28.578738 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:28.579271 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:28.579701 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:28.580397 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:28.580844 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:28.581264 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG oslo_concurrency.lockutils [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:28.584391 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG dbcounter [-] [121744] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:52:28.598079 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.wsgi [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: request: DELETE /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 HTTP/1.1 Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept: application/json Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Accept-Encoding: identity Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Connection: close Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Length: 0 Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Content-Type: application/json Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Host: 10.222.0.102 Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: Openstack-System-Scope: None Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Id: None Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Domain-Name: None Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Identity-Status: Confirmed Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Is-Admin-Project: True Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Id: default Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Domain-Name: Default Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Role: reader,member Sep 01 17:52:28.599634 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Roles: reader,member Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Id: default Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Domain-Name: Default Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: method: > Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: exception: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.601366 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: action_args: {'id': '0120f498-e71f-4898-aef0-57306acb3599'} Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: {{(pid=121744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:28.602255 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.603615 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.605059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: DEBUG nova.api.openstack.wsgi [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. {{(pid=121744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:28.605059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: INFO nova.api.openstack.requestlog [None req-58656bd8-12c2-49fe-b049-cb65ae0ecc7f tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "DELETE /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 404 len: 111 microversion: 2.1 time: 0.034977 Sep 01 17:52:28.605059 dv-cinder-852211-8-iscsi devstack@n-api.service[121744]: [pid: 121744|app: 0|req: 633/1257] 10.222.0.102 () {58 vars in 1244 bytes} [Thu Sep 1 17:52:28 2022] DELETE /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 17:52:28.610116 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Calling method '>' {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:52:28.611227 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.compute.api [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] [instance: 0120f498-e71f-4898-aef0-57306acb3599] Fetching instance by UUID {{(pid=121745) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 17:52:28.613719 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:52:28.619619 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:28.620099 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:28.620531 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:28.621219 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Acquiring lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:52:28.621699 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:52:28.622124 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG oslo_concurrency.lockutils [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Lock "bde3a620-b7c5-42e8-8ce6-210f3b120a6d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:52:28.628045 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG dbcounter [-] [121745] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=121745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:52:28.639618 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.wsgi [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] HTTP exception thrown: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Request method failure captured: Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: request: GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 HTTP/1.1 Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept: application/json Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Accept-Encoding: identity Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Connection: close Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Length: 0 Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Content-Type: application/json Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Host: 10.222.0.102 Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: Openstack-System-Scope: None Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: User-Agent: python-urllib3/1.26.12 Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Auth-Token: gAAAAABjEO9zjxvGLFB21D1txVprWPYSzC_1Z3ned3KLs9_U3rlQ243j04N70UonntlLDsCRLUQ4zepUPO9krMgGKE0u4ezGWO-tsX5pUqIBjmL_6Jvh9yUu6DLe6zPrDFQIegM_x4K7xHqUNIQFsoWRWvY77r4atNaPnYec6JNNJANWgbhTgSw Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Id: None Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Domain-Name: None Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Identity-Status: Confirmed Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Is-Admin-Project: True Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Id: default Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Domain-Name: Default Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Project-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Role: reader,member Sep 01 17:52:28.641580 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Roles: reader,member Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:8080/v1/AUTH_de5f40e77a914f919f5bb15d11181f65", "adminURL": "http://10.222.0.102:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2/de5f40e77a914f919f5bb15d11181f65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.102/volume/v3/de5f40e77a914f919f5bb15d11181f65"}]}] Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Id: de5f40e77a914f919f5bb15d11181f65 Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-982827824 Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Id: default Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Domain-Name: Default Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Id: e7660433575a4daaaed075a6c8934934 Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: X-User-Name: tempest-AttachVolumeNegativeTest-982827824-project Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: method: > Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: exception: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.643267 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: action_args: {'id': '0120f498-e71f-4898-aef0-57306acb3599'} Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: {{(pid=121745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:52:28.644326 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. Sep 01 17:52:28.645910 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: ERROR nova.api.openstack.wsgi Sep 01 17:52:28.647429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: DEBUG nova.api.openstack.wsgi [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] Returning 404 to user: Instance 0120f498-e71f-4898-aef0-57306acb3599 could not be found. {{(pid=121745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:52:28.647429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: INFO nova.api.openstack.requestlog [None req-b341a84e-dd84-4cf4-b088-e355a770172c tempest-AttachVolumeNegativeTest-982827824 tempest-AttachVolumeNegativeTest-982827824-project] 10.222.0.102 "GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599" status: 404 len: 111 microversion: 2.1 time: 0.036945 Sep 01 17:52:28.647429 dv-cinder-852211-8-iscsi devstack@n-api.service[121745]: [pid: 121745|app: 0|req: 625/1258] 10.222.0.102 () {58 vars in 1241 bytes} [Thu Sep 1 17:52:28 2022] GET /compute/v2.1/servers/0120f498-e71f-4898-aef0-57306acb3599 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)